00000001:02000400:3.0F:1788460215.016422:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788460233.753525:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788460235.716361:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 436 MB/s 00000001:01000000:3.0:1788460235.966371:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 719 MB/s 00000001:01000000:3.0:1788460236.232219:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4259 MB/s 00000020:02000000:3.0:1788460237.102096:0:3285:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_7_g065ac5e 00000400:02000000:1.0:1788460238.228257:0:3300:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.132@tcp [8/256/0/180] 00008000:02000000:1.0:1788460241.853340:0:3450:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788460293.843693:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788460303.631002:0:5822:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:3.0:1788460303.631008:0:5822:0:(obd_mount.c:1014:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788460303.631142:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005874c8f8 00000080:02000400:3.0:1788460303.631153:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788460303.645458:0:5822:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788460303.645473:0:5822:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788460303.645524:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000028cd9367) 00000020:00000080:3.0:1788460303.645546:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0F:1788460303.678132:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788460303.678971:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788460303.714908:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788460303.714952:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788460303.714974:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788460303.715028:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788460303.715054:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788460303.715485:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788460303.715493:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788460303.715504:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b6e2f 00000020:01000004:0.0:1788460303.715512:0:5822:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788460303.715518:0:5822:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788460303.715522:0:5822:0:(tgt_mount.c:115:server_register_mount()) register mount 000000005874c8f8 from MGS 00000020:01000004:0.0:1788460303.715527:0:5822:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788460303.715553:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f1d44524) 00000020:00000080:0.0:1788460303.715693:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788460303.715948:0:5822:0:(tgt_mount.c:167:server_get_mount()) get mount 000000005874c8f8 from MGS, refs=2 00080000:01000000:0.0:1788460303.715955:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788460303.715960:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b6e3d 00000100:00100000:0.0:1788460303.716059:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788460303.716238:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788460303.716244:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788460303.719905:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788460303.719920:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788460303.723664:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460303.724074:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788460303.724081:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788460303.726963:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788460303.726982:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788460303.728105:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788460303.728113:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788460303.730460:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460303.730467:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460303.730469:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460303.734823:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460303.734830:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460303.734832:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1788460303.740654:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788460303.747388:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788460303.991895:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1928 MB/s 00000001:01000000:0.0:1788460304.245770:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1657 MB/s 00000001:01000000:2.0:1788460304.496122:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 479 MB/s 00000001:01000000:3.0:1788460304.745214:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 655 MB/s 00080000:10000000:1.0:1788460304.763289:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788460304.782959:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788460304.791997:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788460304.792013:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788460304.792016:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788460304.792915:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788460304.792976:0:5822:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788460304.793014:0:5822:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788460304.793244:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788460304.793271:0:5822:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788460304.793600:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460304.793750:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788460304.793756:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788460304.794630:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788460304.794640:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788460304.794935:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788460304.794942:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788460304.799658:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788460304.799681:0:5822:0:(obd_mount.c:496:lustre_start_mgc()) Start MGC 'mgc192.168.203.132@tcp' 00000020:01000004:0.0:1788460304.799683:0:5822:0:(obd_mount.c:505:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788460304.799728:0:5822:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD mgc192.168.203.132@tcp (typ=mgc) 00000020:00000080:0.0:1788460304.799739:0:5822:0:(genops.c:413:class_newdev()) Allocate new device mgc192.168.203.132@tcp (000000009384ecda) 00000020:00000080:0.0:1788460304.799754:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788460304.799843:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000015723075@mgc192.168.203.132@tcp: add connection 192.168.203.132@tcp at head 00000100:00080000:1.0:1788460304.799946:0:5838:0:(pinger.c:473:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1788460304.802808:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mgc192.168.203.132@tcp-0 is initialized 00000040:01000000:0.0:1788460304.802818:0:5822:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788460304.809337:0:5839:0:(mgc_request.c:900:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788460304.809427:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd mgc192.168.203.132@tcp (uuid ce24ccd6-bef2-4d18-b934-4ac2305873bc) 00000020:00000080:0.0:1788460304.809451:0:5822:0:(genops.c:1385:class_connect()) connect: client ce24ccd6-bef2-4d18-b934-4ac2305873bc, cookie 0x889bb893541b6e4b 00000100:00080000:0.0:1788460304.809463:0:5822:0:(import.c:545:import_select_connection()) mgc192.168.203.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788460304.809468:0:5822:0:(import.c:665:import_select_connection()) mgc192.168.203.132@tcp: import 0000000015723075 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460304.809514:0:5822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f68a2fd5 x1875336482521216/t0(0) o250->mgc192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460304.809542:0:5822:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import ce24ccd6-bef2-4d18-b934-4ac2305873bc->MGS 00000020:01000004:0.0:1788460304.809561:0:5822:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788460304.809566:0:5822:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:1.0:1788460304.809784:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f68a2fd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3315:1875336482521216:0@lo:250: 00000100:00100000:1.0:1788460304.809860:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788460304.810114:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ed336d71) 00000020:00000080:0.0:1788460304.810129:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788460304.811241:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482521216 00000100:00100000:1.0:1788460304.811251:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482521216 00000100:00100000:1.0:1788460304.811298:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460304.811304:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e22886b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3315:x1875336482521216:12345-0@lo:250: 00010000:00080000:1.0:1788460304.811327:0:5834:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from ce24ccd6-bef2-4d18-b934-4ac2305873bc@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:1.0:1788460304.811355:0:5834:0:(genops.c:1385:class_connect()) connect: client ce24ccd6-bef2-4d18-b934-4ac2305873bc, cookie 0x889bb893541b6e59 00000100:00080000:1.0:1788460304.811493:0:5834:0:(import.c:65:import_set_state_nolock()) 0000000091ab2c32 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460304.811562:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e22886b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:3315:x1875336482521216:12345-0@lo:250: Request processed in 256us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460304.811569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460304.812706:0:3315:0:(client.c:3126:ptlrpc_free_committed()) mgc192.168.203.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788460304.812717:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) mgc192.168.203.132@tcp: connect to target with instance 0 00000100:00080000:1.0:1788460304.812724:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) mgc192.168.203.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788460304.812729:0:3315:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788460304.812732:0:3315:0:(import.c:65:import_set_state_nolock()) 0000000015723075 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788460304.812735:0:3315:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788460304.812744:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788460304.812749:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f68a2fd5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3315:1875336482521216:0@lo:250: 00000100:00100000:0.0:1788460304.825795:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460304.826004:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788460304.826011:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788460304.830993:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788460304.831142:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788460304.831669:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788460304.831676:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788460304.832392:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460304.832995:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788460304.833003:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788460304.834554:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788460304.834565:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788460304.896999:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460304.898660:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788460304.898670:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788460304.900099:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788460304.900116:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788460304.901810:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460304.902002:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788460304.902009:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788460304.902792:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788460304.902800:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788460304.903555:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460304.903724:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788460304.903729:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788460304.904278:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788460304.904286:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788460304.905162:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460304.905511:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788460304.905517:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788460304.906383:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788460304.906392:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788460304.936576:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460304.936758:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788460304.936764:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788460304.940778:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788460304.940791:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788460304.942147:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460304.942158:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788460304.943717:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788460304.943763:0:5822:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788460304.943769:0:5822:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788460304.943771:0:5822:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460304.943779:0:5822:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460304.943780:0:5822:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460304.943781:0:5822:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460304.943782:0:5822:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460304.943783:0:5822:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460304.943784:0:5822:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460304.943785:0:5822:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788460304.943786:0:5822:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788460304.943787:0:5822:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460304.943788:0:5822:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460304.943791:0:5822:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788460304.943793:0:5822:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460304.943794:0:5822:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460304.943795:0:5822:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460304.943795:0:5822:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460304.943796:0:5822:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460304.943797:0:5822:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460304.943797:0:5822:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460304.943798:0:5822:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460304.943799:0:5822:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788460304.943800:0:5822:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788460304.943800:0:5822:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460304.943801:0:5822:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460304.943833:0:5822:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788460304.943851:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521344:0@lo:253: 00000100:00100000:3.0:1788460304.943937:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460304.944014:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5c8f9e3 going to sleep for 11 seconds 00000100:00100000:0.0:1788460304.944123:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482521344 00000100:00100000:0.0:1788460304.944131:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482521344 00000100:00100000:0.0:1788460304.944295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460304.944304:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064dc8825 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5822:x1875336482521344:12345-0@lo:253: 20000000:01000000:0.0:1788460304.944350:0:5837:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788460304.944354:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788460304.944657:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788460304.944720:0:5837:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788460304.944987:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460304.946320:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788460304.946551:0:5837:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788460304.946555:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788460304.946561:0:5837:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788460304.946564:0:5837:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788460304.946578:0:5837:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788460304.946770:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460304.947012:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788460304.947025:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788460304.947150:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788460304.947538:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788460304.947582:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788460304.947672:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788460304.947680:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788460304.947738:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788460304.947747:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788460304.947778:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788460304.947785:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788460304.947814:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788460304.947859:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788460304.947889:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788460304.947893:0:5837:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788460304.947904:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460304.948173:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788460304.948255:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788460304.948291:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788460304.948323:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788460304.948366:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788460304.948377:0:5837:0:(mgs_llog.c:3135:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788460304.948469:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788460304.948478:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788460304.948786:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788460304.948823:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788460304.948854:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788460304.948863:0:5837:0:(mgs_llog.c:3100:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788460304.948940:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788460304.948948:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788460304.948978:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788460304.949009:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788460304.949318:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788460304.949364:0:5837:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788460304.949372:0:5837:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788460304.949872:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788460304.950354:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788460304.950376:0:5837:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.132@tcp for mdt 20000000:01000000:0.0:1788460304.950378:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:0.0:1788460304.950436:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788460304.950444:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788460304.950475:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788460304.950483:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:0.0:1788460304.950537:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788460304.950548:0:5837:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788460304.950581:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788460304.950615:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788460304.950676:0:5837:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788460304.950679:0:5837:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788460304.950685:0:5837:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788460304.950690:0:5837:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788460304.951109:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788460304.951365:0:5837:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788460304.961545:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788460304.961598:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788460304.961665:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788460304.961682:0:5837:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788460304.961685:0:5837:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788460304.961688:0:5837:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788460304.961700:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788460304.961703:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788460304.961732:0:5837:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788460304.961734:0:5837:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788460304.962617:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788460304.962915:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788460304.962955:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788460304.963015:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1788460304.963029:0:5837:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788460304.963032:0:5837:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788460304.963547:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788460304.963756:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788460304.963795:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788460304.963828:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788460304.963840:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788460304.963842:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788460304.963848:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788460304.963873:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963888:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963897:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963903:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963909:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963915:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963923:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052a95aa1 already unused, calling callback (0000000012f50c03) 00010000:00010000:3.0:1788460304.963927:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963934:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963945:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963951:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460304.963957:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000052a95aa1/0x889bb893541b6e60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788460304.963983:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788460305.237930:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064dc8825 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5822:x1875336482521344:12345-0@lo:253: Request processed in 293619us (293985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460305.238016:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788460305.238280:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521344:0@lo:253: 10000000:01000000:3.0:1788460305.238358:0:5822:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788460305.238361:0:5822:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788460305.238363:0:5822:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460305.238364:0:5822:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460305.238365:0:5822:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788460305.238366:0:5822:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460305.238367:0:5822:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460305.238368:0:5822:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460305.238370:0:5822:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460305.238371:0:5822:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788460305.238373:0:5822:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460305.238374:0:5822:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788460305.238392:0:5822:0:(tgt_mount.c:115:server_register_mount()) register mount 000000005874c8f8 from lustre-MDT0000 10000000:01000000:3.0:1788460305.238425:0:5822:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788460305.238428:0:5822:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788460305.238431:0:5822:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9650c5118800 10000000:01000000:3.0:1788460305.238437:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460305.238453:0:5822:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650c5118800 from 1 10000000:01000000:3.0:1788460305.238455:0:5822:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788460305.238491:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.238501:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.238509:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.238526:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521472:0@lo:101: 00000100:00100000:3.0:1788460305.238572:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.238674:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc7c0222 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.238821:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482521472 00000100:00100000:1.0:1788460305.238828:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482521472 00000100:00100000:1.0:1788460305.238905:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460305.238912:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000806f27b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5822:x1875336482521472:12345-0@lo:101: 00010000:00010000:1.0:1788460305.238924:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460305.238947:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6e67 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.238969:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6e67 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.238979:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6e67 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.238987:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ad2e3cf, rc 0) 00000100:00100000:1.0:1788460305.239028:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000806f27b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+6:5822:x1875336482521472:12345-0@lo:101: Request processed in 117us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460305.239228:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521472:0@lo:101: 00010000:00010000:3.0:1788460305.239241:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.239248:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.239349:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521600:0@lo:501: 00000100:00100000:3.0:1788460305.239377:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460305.239447:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788460305.239534:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc7c0222 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.239620:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482521600 00000100:00100000:1.0:1788460305.239625:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482521600 00000100:00100000:1.0:1788460305.239641:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460305.239646:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004bd2f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+6:5822:x1875336482521600:12345-0@lo:501: 00000100:00100000:1.0:1788460305.239858:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004bd2f46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+6:5822:x1875336482521600:12345-0@lo:501: Request processed in 211us (480us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460305.239865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460305.239937:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521600:0@lo:501: 10000000:01000000:3.0:1788460305.239951:0:5822:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788460305.239967:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.239975:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460305.239983:0:5822:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9650c5118800 10000000:01000000:3.0:1788460305.239987:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788460305.240006:0:5822:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9650c5118800 10000000:01000000:3.0:1788460305.240010:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788460305.240019:0:5822:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-barrier-ffff9650c5118800 from 1 10000000:01000000:3.0:1788460305.240022:0:5822:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788460305.240240:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 00000000fa2af877/0x889bb893541b6e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.240259:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 00000000fa2af877/0x889bb893541b6e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.240268:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 00000000fa2af877/0x889bb893541b6e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.240280:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521728:0@lo:101: 00000100:00100000:3.0:1788460305.240373:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.240394:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc7c0222 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.240456:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482521728 00000100:00100000:1.0:1788460305.240461:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482521728 00000100:00100000:1.0:1788460305.240481:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460305.240487:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000849efda7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+6:5822:x1875336482521728:12345-0@lo:101: 00010000:00010000:1.0:1788460305.240495:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460305.240505:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa0f1f43/0x889bb893541b6e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6e75 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.240521:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa0f1f43/0x889bb893541b6e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6e75 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.240538:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa0f1f43/0x889bb893541b6e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6e75 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.240544:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa0f1f43, rc 0) 00000100:00100000:1.0:1788460305.240580:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000849efda7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+7:5822:x1875336482521728:12345-0@lo:101: Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.240586:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460305.240655:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521728:0@lo:101: 00010000:00010000:3.0:1788460305.240665:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 00000000fa2af877/0x889bb893541b6e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.240672:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 00000000fa2af877/0x889bb893541b6e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460305.240682:0:5822:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788460305.240695:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 00000000fa2af877/0x889bb893541b6e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.240701:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 00000000fa2af877/0x889bb893541b6e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460305.240707:0:5822:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788460305.240710:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460305.240725:0:5822:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9650c5118800 10000000:01000000:3.0:1788460305.240728:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788460305.240739:0:5822:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788460305.240748:0:5822:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788460305.240762:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.240768:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.240774:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.240785:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521856:0@lo:101: 00000100:00100000:3.0:1788460305.240809:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.240819:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc7c0222 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.240876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482521856 00000100:00100000:1.0:1788460305.240881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482521856 00000100:00100000:1.0:1788460305.240896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460305.240900:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000193e1471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+7:5822:x1875336482521856:12345-0@lo:101: 00010000:00010000:1.0:1788460305.240906:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460305.240913:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6e83 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.240924:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6e83 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.240931:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6e83 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.240936:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007027e822, rc 0) 00000100:00100000:1.0:1788460305.240969:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000193e1471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+8:5822:x1875336482521856:12345-0@lo:101: Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.240975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460305.241116:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521856:0@lo:101: 00010000:00010000:3.0:1788460305.241226:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.241234:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.241261:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521984:0@lo:501: 00000100:00100000:3.0:1788460305.241388:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.241455:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc7c0222 going to sleep for 11 seconds 00000100:00100000:2.0:1788460305.241508:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482521984 00000100:00100000:2.0:1788460305.241513:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482521984 00000100:00100000:1.0:1788460305.241641:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460305.241649:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e887ef5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+8:5822:x1875336482521984:12345-0@lo:501: 00000100:00100000:1.0:1788460305.241921:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e887ef5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5822:x1875336482521984:12345-0@lo:501: Request processed in 273us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.241929:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460305.242246:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482521984:0@lo:501: 00000100:00100000:3.0:1788460305.242279:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522112:0@lo:503: 00000100:00100000:3.0:1788460305.242381:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.242450:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc7c0222 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.242486:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482522112 00000100:00100000:1.0:1788460305.242491:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482522112 00000100:00100000:1.0:1788460305.242552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460305.242560:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e02e2ce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5822:x1875336482522112:12345-0@lo:503: 00000100:00100000:1.0:1788460305.242707:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e02e2ce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5822:x1875336482522112:12345-0@lo:503: Request processed in 148us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.242714:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460305.242777:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522112:0@lo:503: 00000100:00100000:3.0:1788460305.243224:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5865:1875336482522240:0@lo:502: 00000100:00100000:3.0:1788460305.243259:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.243544:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cfea3a7c going to sleep for 11 seconds 00000100:00100000:2.0:1788460305.243614:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482522240 00000100:00100000:2.0:1788460305.243619:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482522240 00000100:00100000:2.0:1788460305.243651:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460305.243657:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e3c64f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5865:x1875336482522240:12345-0@lo:502: 00000100:00100000:2.0:1788460305.243840:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e3c64f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5865:x1875336482522240:12345-0@lo:502: Request processed in 183us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460305.243847:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460305.243938:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5865:1875336482522240:0@lo:502: 00000020:01000000:3.0:1788460305.243961:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460305.243971:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460305.243973:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788460305.243978:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788460305.243981:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460305.243993:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001867203f) 00000020:00000080:3.0:1788460305.244009:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788460305.244014:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788460305.244282:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788460305.244358:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b6e98 00000020:00000080:3.0:1788460305.244578:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788460305.244583:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460305.244586:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460305.244588:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788460305.244590:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460305.244594:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460305.244596:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788460305.244599:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460305.244607:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ad8b3168) 00000020:00000080:3.0:1788460305.244617:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788460305.244620:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788460305.244622:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788460305.244625:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788460305.244631:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788460305.244670:0:5865:0:(tgt_mount.c:167:server_get_mount()) get mount 000000005874c8f8 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788460305.244683:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b1154e08) 00000020:00000080:3.0:1788460305.244689:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788460305.244762:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788460305.244767:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b6ead 00000020:00000080:3.0:1788460305.244864:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788460305.244870:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788460305.244875:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x889bb893541b6eb4 00080000:01000000:3.0:1788460305.244880:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788460305.244883:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b6ebb 00080000:10000000:3.0:1788460305.245557:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788460305.245761:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788460305.250800:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788460305.333634:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788460305.336393:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788460305.340327:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788460305.340609:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788460305.379022:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000469fa179) 00000020:00000080:2.0:1788460305.379114:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788460305.380603:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788460305.380615:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b6ec9 00000020:00000080:3.0:1788460305.386828:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788460305.388026:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460305.420584:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460305.440478:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460305.463129:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460305.499105:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460305.548685:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788460305.579864:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x889bb893541b6ed0 00000020:00000080:2.0:1788460305.580226:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788460305.580236:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460305.580241:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460305.580243:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788460305.580246:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460305.580251:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460305.580253:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788460305.580257:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788460305.580302:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788460305.580320:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460305.580323:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460305.580325:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788460305.580328:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460305.580330:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460305.580331:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788460305.580334:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788460305.580335:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788460305.580383:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001863c19 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5865:1875336482522368:0@lo:502: 00000100:00100000:2.0:1788460305.580478:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460305.580534:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f07287dd going to sleep for 11 seconds 00000100:00100000:2.0:1788460305.580555:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482522368 00000100:00100000:2.0:1788460305.580562:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482522368 00000100:00100000:2.0:1788460305.580596:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460305.580603:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053356fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5865:x1875336482522368:12345-0@lo:502: 00000100:00100000:2.0:1788460305.580883:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053356fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5865:x1875336482522368:12345-0@lo:502: Request processed in 280us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460305.580891:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460305.580939:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001863c19 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5865:1875336482522368:0@lo:502: 00000020:01000000:2.0:1788460305.580962:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460305.580966:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460305.580968:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788460305.580971:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788460305.581285:0:5822:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788460305.581293:0:5822:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788460305.581306:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.581316:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460305.581323:0:5822:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5118800 from 1 10000000:01000000:2.0:1788460305.581327:0:5822:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460305.581350:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.581357:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.581366:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460305.581385:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001863c19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522496:0@lo:101: 00000100:00100000:2.0:1788460305.581423:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460305.581445:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000073f564b0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460305.581688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482522496 00000100:00100000:0.0:1788460305.581693:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482522496 00000100:00100000:0.0:1788460305.581723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460305.581730:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001338e227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5822:x1875336482522496:12345-0@lo:101: 00010000:00010000:0.0:1788460305.581739:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460305.581751:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009769a8bf/0x889bb893541b6ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6ed7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460305.581770:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009769a8bf/0x889bb893541b6ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6ed7 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460305.581780:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009769a8bf/0x889bb893541b6ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6ed7 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460305.581787:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009769a8bf, rc 0) 00000100:00100000:0.0:1788460305.581869:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001338e227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482522496:12345-0@lo:101: Request processed in 140us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460305.581876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788460305.581978:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001863c19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522496:0@lo:101: 00010000:00010000:3.0:1788460305.581991:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.581998:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.582644:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522624:0@lo:256: 00000100:00100000:3.0:1788460305.582683:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.582760:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082ae789b going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.582802:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482522624 00000100:00100000:1.0:1788460305.582807:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482522624 00000100:00100000:1.0:1788460305.582879:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460305.582887:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fe77528 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482522624:12345-0@lo:256: 00000100:00100000:1.0:1788460305.582936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fe77528 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482522624:12345-0@lo:256: Request processed in 51us (252us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788460305.582943:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788460305.583002:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522624:0@lo:256: 10000000:01000000:3.0:1788460305.583609:0:5822:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' failed (-11). 00010000:00010000:3.0:1788460305.583617:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.583626:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460305.583633:0:5822:0:(mgc_request.c:2375:mgc_process_log()) mgc192.168.203.132@tcp: IR log lustre-mdtir not ready yet: rc = -11 00010000:00010000:3.0:1788460305.583637:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.583643:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.583649:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.583654:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.583675:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788460305.583683:0:5822:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5118800 from 1 10000000:01000000:3.0:1788460305.583686:0:5822:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460305.583708:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.583715:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.583723:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.583743:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522752:0@lo:101: 00000100:00100000:3.0:1788460305.583775:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460305.583923:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460305.583929:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.583937:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c71813ee already unused, calling callback (00000000891224fe) 10000000:00010000:2.0:1788460305.583940:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.583948:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460305.583954:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460305.583960:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460305.583978:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.583985:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460305.584001:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.584007:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: 00000000c71813ee/0x889bb893541b6ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b6ede expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.584022:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460305.584030:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460305.584032:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460305.584080:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2569510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482522880:0@lo:103: 00000100:00100000:2.0:1788460305.584108:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460305.584196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482522880 00000100:00100000:2.0:1788460305.584201:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482522880 00000100:00100000:2.0:1788460305.584235:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460305.584241:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6598cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:3317:x1875336482522880:12345-0@lo:103: 00010000:00010000:2.0:1788460305.584251:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460305.584262:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009769a8bf/0x889bb893541b6ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b6ed7 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.584276:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460305.584315:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6598cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:3317:x1875336482522880:12345-0@lo:103: Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460305.584322:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460305.584358:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2569510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482522880:0@lo:103: 00000100:00100000:3.0:1788460305.584565:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e51af465 going to sleep for 11 seconds 00000100:00100000:0.0:1788460305.584634:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482522752 00000100:00100000:0.0:1788460305.584640:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482522752 00000100:00100000:0.0:1788460305.584660:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460305.584666:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdb4e2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:5822:x1875336482522752:12345-0@lo:101: 00010000:00010000:0.0:1788460305.584675:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460305.584685:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6ee5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460305.584702:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460305.584723:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460305.584730:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea4e5bfe, rc 0) 00000100:00100000:0.0:1788460305.584767:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdb4e2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482522752:12345-0@lo:101: Request processed in 101us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460305.584773:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460305.584856:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482522752:0@lo:101: 00010000:00010000:3.0:1788460305.584867:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.584875:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.584907:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523008:0@lo:501: 00000100:00100000:3.0:1788460305.584931:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.584949:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e51af465 going to sleep for 11 seconds 00000100:00100000:0.0:1788460305.585001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523008 00000100:00100000:0.0:1788460305.585005:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523008 00000100:00100000:0.0:1788460305.585021:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460305.585026:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d5b28a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482523008:12345-0@lo:501: 00000100:00100000:0.0:1788460305.585631:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d5b28a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482523008:12345-0@lo:501: Request processed in 603us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460305.585638:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788460305.585865:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523008:0@lo:501: 00000100:00100000:3.0:1788460305.585893:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523136:0@lo:503: 00000100:00100000:3.0:1788460305.585930:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.585958:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e51af465 going to sleep for 11 seconds 00000100:00100000:0.0:1788460305.586003:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523136 00000100:00100000:0.0:1788460305.586008:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523136 00000100:00100000:0.0:1788460305.586074:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460305.586082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000722d73ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482523136:12345-0@lo:503: 00000040:00080000:0.0:1788460305.586114:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460305.586158:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000722d73ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482523136:12345-0@lo:503: Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460305.586164:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788460305.586386:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523136:0@lo:503: 00000040:00080000:3.0:1788460305.587213:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788460305.587431:0:5822:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788460305.587439:0:5822:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460305.587458:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.587468:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460305.587507:0:5822:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788460305.587509:0:5822:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9650c5118800 10000000:01000000:2.0:1788460305.587512:0:5822:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9650c5118800 10000000:01000000:2.0:1788460305.587517:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460305.587541:0:5822:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650c5118800 from 1 10000000:01000000:2.0:1788460305.587544:0:5822:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788460305.587571:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.587579:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.587587:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460305.587604:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2569510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523264:0@lo:101: 00000100:00100000:2.0:1788460305.587643:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460305.587669:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df9b8966 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.587750:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523264 00000100:00100000:1.0:1788460305.587756:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523264 00000100:00100000:1.0:1788460305.587795:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460305.587802:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb350b8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:5822:x1875336482523264:12345-0@lo:101: 00010000:00010000:1.0:1788460305.587812:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460305.587822:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6ef3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.587841:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.587860:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460305.587867:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ce0961b, rc 0) 00000100:00100000:1.0:1788460305.587906:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb350b8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5822:x1875336482523264:12345-0@lo:101: Request processed in 105us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.587912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788460305.587996:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2569510 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523264:0@lo:101: 00010000:00010000:3.0:1788460305.588008:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460305.588016:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.588050:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523392:0@lo:501: 00000100:00100000:3.0:1788460305.588074:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.588094:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000006edd7636 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.588136:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523392 00000100:00100000:1.0:1788460305.588140:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523392 00000100:00100000:1.0:1788460305.588156:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460305.588161:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c92e07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5822:x1875336482523392:12345-0@lo:501: 00000100:00100000:1.0:1788460305.588532:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c92e07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5822:x1875336482523392:12345-0@lo:501: Request processed in 370us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.588539:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788460305.588599:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523392:0@lo:501: 00000100:00100000:3.0:1788460305.588623:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523520:0@lo:503: 00000100:00100000:3.0:1788460305.588655:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460305.588674:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000006edd7636 going to sleep for 11 seconds 00000100:00100000:2.0:1788460305.588735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523520 00000100:00100000:2.0:1788460305.588739:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523520 00000100:00100000:2.0:1788460305.588759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460305.588765:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d489c7fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5822:x1875336482523520:12345-0@lo:503: 00000100:00100000:2.0:1788460305.589057:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d489c7fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5822:x1875336482523520:12345-0@lo:503: Request processed in 291us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460305.589064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788460305.589165:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482523520:0@lo:503: 00000100:00100000:0.0:1788460305.589781:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca56eb3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5870:1875336482523648:0@lo:502: 00000100:00100000:0.0:1788460305.589823:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460305.589893:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d63eb392 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.589924:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523648 00000100:00100000:1.0:1788460305.589929:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523648 00000100:00100000:1.0:1788460305.589988:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460305.589996:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001913d43b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5870:x1875336482523648:12345-0@lo:502: 00000100:00100000:1.0:1788460305.590376:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001913d43b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5870:x1875336482523648:12345-0@lo:502: Request processed in 381us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.590383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788460305.590459:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca56eb3e pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5870:1875336482523648:0@lo:502: 00000020:01000004:0.0:1788460305.590517:0:5870:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788460305.590530:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000bc9f462e) 00000020:00000080:0.0:1788460305.590547:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788460305.590625:0:5870:0:(tgt_mount.c:167:server_get_mount()) get mount 000000005874c8f8 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788460305.590629:0:5870:0:(tgt_mount.c:201:server_put_mount()) put mount 000000005874c8f8 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788460305.590631:0:5870:0:(obd_mount.c:798:lustre_put_lsi()) put 000000005874c8f8 4 00010000:00080000:0.0:1788460305.590656:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009cee2da2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:0.0:1788460305.592295:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788460305.592508:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788460305.592542:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788460305.592555:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x889bb893541b6f08 00000100:00080000:0.0:1788460305.592564:0:5870:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788460305.592569:0:5870:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009cee2da2 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460305.592611:0:5870:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ca56eb3e x1875336482523776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460305.592636:0:5870:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788460305.596583:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca56eb3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482523776:0@lo:38: 00000100:00100000:1.0:1788460305.596668:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460305.598549:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089ca752b pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5870:1875336482523904:0@lo:502: 00000100:00100000:1.0:1788460305.598619:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460305.598662:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523904 00000100:00100000:1.0:1788460305.598668:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523904 00000100:00100000:1.0:1788460305.598710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460305.598718:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045485637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5870:x1875336482523904:12345-0@lo:502: 00000100:00100000:1.0:1788460305.598918:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045485637 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5870:x1875336482523904:12345-0@lo:502: Request processed in 200us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460305.598926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460305.598969:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dca9ef93 going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.598989:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089ca752b pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5870:1875336482523904:0@lo:502: 00000040:00080000:1.0:1788460305.599012:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1788460305.599270:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482523776 00000100:00100000:2.0:1788460305.599276:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482523776 00000100:00100000:2.0:1788460305.599439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460305.599444:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032567a70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482523776:12345-0@lo:38: 00000100:00100000:2.0:1788460305.599498:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032567a70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482523776:12345-0@lo:38: Request processed in 52us (2829us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788460305.599503:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460305.599548:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788460305.599558:0:3315:0:(import.c:65:import_set_state_nolock()) 000000009cee2da2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460305.599562:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788460305.599566:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca56eb3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482523776:0@lo:38: 00000020:01000000:2.0:1788460305.599591:0:5822:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788460305.599599:0:5822:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788460305.599611:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.599622:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788460305.599669:0:5822:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788460305.599671:0:5822:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460305.599672:0:5822:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460305.599673:0:5822:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460305.599674:0:5822:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460305.599676:0:5822:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460305.599677:0:5822:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460305.599679:0:5822:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460305.599680:0:5822:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788460305.599681:0:5822:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788460305.599683:0:5822:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460305.599684:0:5822:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460305.599687:0:5822:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788460305.599689:0:5822:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788460305.599691:0:5822:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460305.599692:0:5822:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460305.599692:0:5822:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460305.599693:0:5822:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460305.599695:0:5822:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460305.599696:0:5822:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460305.599697:0:5822:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460305.599698:0:5822:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788460305.599699:0:5822:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788460305.599700:0:5822:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460305.599700:0:5822:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460305.599719:0:5822:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788460305.599728:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ce9e121 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482524032:0@lo:253: 00000100:00100000:2.0:1788460305.599760:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460305.599780:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4f6c32a going to sleep for 11 seconds 00000100:00100000:1.0:1788460305.599897:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524032 00000100:00100000:1.0:1788460305.599901:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524032 00000100:00100000:1.0:1788460305.599929:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460305.599935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094ef5200 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5822:x1875336482524032:12345-0@lo:253: 20000000:01000000:1.0:1788460305.599953:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788460305.599965:0:5834:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788460305.620976:0:5834:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788460305.620988:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788460305.621091:0:5858:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788460305.621097:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788460305.621116:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621132:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788460305.621141:0:5858:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000045582s 00010000:00010000:2.0:1788460305.621145:0:5858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621150:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621157:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621163:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621169:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c71813ee already unused, calling callback (0000000012f50c03) 00010000:00010000:2.0:1788460305.621172:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621206:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621219:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621238:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460305.621244:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c71813ee/0x889bb893541b6f0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460305.627597:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094ef5200 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5822:x1875336482524032:12345-0@lo:253: Request processed in 27655us (27830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460305.627617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460305.629608:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ce9e121 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5822:1875336482524032:0@lo:253: 10000000:01000000:0.0:1788460305.629627:0:5822:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788460305.629630:0:5822:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788460305.629631:0:5822:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788460305.629633:0:5822:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460305.629633:0:5822:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460305.629635:0:5822:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460305.629636:0:5822:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460305.629637:0:5822:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788460305.629638:0:5822:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788460305.629639:0:5822:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788460305.629641:0:5822:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788460305.629642:0:5822:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460305.629643:0:5822:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788460305.629656:0:5822:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788460305.634322:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460305.634729:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460305.634925:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460305.635093:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460305.635317:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460305.635515:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788460305.636602:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460305.636786:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788460305.636980:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460305.637149:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788460305.637504:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460305.637675:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788460305.672347:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788460305.699950:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788460305.700461:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788460305.702931:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788460305.703084:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788460305.703551:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788460305.703559:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788460305.703685:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788460305.705647:0:5875:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788460305.705656:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788460305.706672:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788460305.707277:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788460305.707442:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788460305.707793:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788460305.708031:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788460305.713012:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788460305.713197:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788460305.713526:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788460305.713716:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788460305.713848:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788460305.713991:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788460305.714123:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788460305.714324:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788460305.714481:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788460305.714626:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788460305.714791:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788460305.714961:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788460305.715131:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788460305.715392:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788460305.715559:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788460305.715699:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788460305.715940:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788460305.716084:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788460305.716238:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788460305.716376:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788460305.717011:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788460305.717156:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788460305.721165:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788460305.726432:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788460305.727004:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788460305.727142:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788460305.727348:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788460305.727505:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788460305.727825:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788460305.727976:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788460305.728113:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788460305.728251:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788460305.729085:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788460305.763772:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:1.0:1788460305.808586:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788460305.811457:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788460305.811499:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa77dc1c5f9b8 00100000:10000000:1.0:1788460305.811507:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788460305.817361:0:5822:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788460305.817390:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788460305.879556:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788460305.879696:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788460305.879701:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788460306.828448:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460307.852528:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460308.878330:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460309.900504:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788460310.523757:0:6118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788460310.924570:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788460311.060039:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788460311.060048:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788460311.060051:0:38:0:(import.c:65:import_set_state_nolock()) 000000009cee2da2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460311.060062:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009cee2da2 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1788460311.060082:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000539c61fa x1875336482524288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460311.060209:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482524160:0@lo:400: 00000100:00100000:3.0:1788460311.060521:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460311.062163:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000539c61fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482524288:0@lo:38: 00000100:00100000:3.0:1788460311.062234:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460311.062431:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524288 00000100:00100000:2.0:1788460311.062440:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524288 00000100:00100000:2.0:1788460311.062481:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460311.062487:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e1a5211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1875336482524288:12345-0@lo:38: 00010000:00080000:2.0:1788460311.062510:0:5844:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1788460311.062546:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x889bb893541b6f16 00000004:00100000:2.0:1788460311.062584:0:5844:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788460311.062713:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000a3372b19 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460311.062763:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e1a5211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875336482524288:12345-0@lo:38: Request processed in 275us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460311.062771:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460311.063121:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524160 00000100:00100000:0.0:1788460311.063127:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524160 00000100:00100000:0.0:1788460311.063158:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460311.063164:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000544b56a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:3318:x1875336482524160:12345-0@lo:400: 00000100:00100000:0.0:1788460311.063235:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000544b56a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:3318:x1875336482524160:12345-0@lo:400: Request processed in 71us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460311.063241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788460311.063528:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000539c61fa x1875336482524288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788460311.063545:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788460311.063552:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788460311.063556:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788460311.063558:0:3315:0:(import.c:65:import_set_state_nolock()) 000000009cee2da2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788460311.063563:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000539c61fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482524288:0@lo:38: 00000100:00100000:3.0:1788460311.063596:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482524160:0@lo:400: 00010000:00010000:2.0:1788460311.948732:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788460312.588867:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460312.588875:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5118800 from 1 10000000:01000000:2.0:1788460312.588880:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460312.588923:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 000000001a762cca/0x889bb893541b6f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460312.588935:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 000000001a762cca/0x889bb893541b6f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460312.588956:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 000000001a762cca/0x889bb893541b6f1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460312.588976:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482524416:0@lo:101: 00000100:00100000:2.0:1788460312.589037:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460312.589107:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000005546b207 going to sleep for 11 seconds 00000100:00100000:3.0:1788460312.589139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524416 00000100:00100000:3.0:1788460312.589148:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524416 00000100:00100000:3.0:1788460312.589209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788460312.589217:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000685c6c97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:5839:x1875336482524416:12345-0@lo:101: 00010000:00010000:3.0:1788460312.589229:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460312.589240:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d98dcb9/0x889bb893541b6f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6f1d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460312.589260:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d98dcb9/0x889bb893541b6f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6f1d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460312.589269:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d98dcb9/0x889bb893541b6f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f1d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460312.589276:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d98dcb9, rc 0) 00000100:00100000:3.0:1788460312.589324:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000685c6c97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:5839:x1875336482524416:12345-0@lo:101: Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460312.589444:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482524416:0@lo:101: 00010000:00010000:2.0:1788460312.589458:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 000000001a762cca/0x889bb893541b6f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460312.589466:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 000000001a762cca/0x889bb893541b6f1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460312.590587:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482524544:0@lo:256: 00000100:00100000:2.0:1788460312.590643:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460312.590730:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000005546b207 going to sleep for 11 seconds 00000100:00100000:0.0:1788460312.590796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524544 00000100:00100000:0.0:1788460312.590802:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524544 00000100:00100000:0.0:1788460312.590855:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460312.590862:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb351f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:5839:x1875336482524544:12345-0@lo:256: 20000000:01000000:0.0:1788460312.590880:0:5836:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788460312.590896:0:5836:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788460312.590900:0:5836:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788460312.590923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460312.590995:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb351f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:5839:x1875336482524544:12345-0@lo:256: Request processed in 124us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460312.591003:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788460312.591130:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482524544:0@lo:256: 10000000:01000000:2.0:1788460312.594233:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460312.594249:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 000000001a762cca/0x889bb893541b6f1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460312.594262:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 000000001a762cca/0x889bb893541b6f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460312.972520:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460313.997636:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460315.021615:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788460315.271726:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc700cfc40 20000000:00000080:3.0:1788460315.271740:0:6320:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9650fd69ac00 uarg=0000000000000000 20000000:01000000:3.0:1788460315.271838:0:6320:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788460315.271845:0:6320:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788460315.271849:0:6320:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788460315.272096:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788460315.272105:0:6320:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788460315.279108:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460315.284539:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788460315.284627:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788460315.284676:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788460315.284695:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788460315.284713:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460315.284730:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460315.284737:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460315.284903:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460315.284927:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 11 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460315.284940:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fffce617 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875336482524672:0@lo:104: 00000100:00100000:0.0:1788460315.284998:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460315.285145:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e3d3c10 going to sleep for 11 seconds 00000100:00100000:2.0:1788460315.285399:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524672 00000100:00100000:2.0:1788460315.285407:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524672 00000100:00100000:2.0:1788460315.285497:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460315.285505:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094590be0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:6320:x1875336482524672:12345-0@lo:104: 00010000:00010000:2.0:1788460315.285517:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460315.285588:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460315.285593:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094590be0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:6320:x1875336482524672:12345-0@lo:104: Request processed in 90us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460315.285600:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788460315.285637:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460315.285642:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285649:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a932fca5 already unused, calling callback (00000000891224fe) 10000000:00010000:3.0:1788460315.285652:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285660:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460315.285667:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460315.285673:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788460315.285702:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285709:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460315.285723:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285739:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6ee5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6eec expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285756:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460315.285757:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460315.285759:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460315.285787:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482524800:0@lo:103: 00000100:00100000:3.0:1788460315.285817:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460315.285858:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524800 00000100:00100000:3.0:1788460315.285862:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524800 00010000:00010000:3.0:1788460315.285878:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 12 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460315.285898:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460315.285903:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000539c61fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:3319:x1875336482524800:12345-0@lo:103: 00010000:00010000:3.0:1788460315.285911:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460315.285915:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 12 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285924:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 12 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285938:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285945:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285958:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285970:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285975:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285980:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285985:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005682bd4d already unused, calling callback (0000000012f50c03) 00010000:00010000:3.0:1788460315.285988:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.285994:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.286014:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460315.286024:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460315.286049:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000539c61fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:3319:x1875336482524800:12345-0@lo:103: Request processed in 147us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460315.286056:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460315.286089:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482524800:0@lo:103: 00010000:00010000:0.0:1788460315.286162:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea4e5bfe/0x889bb893541b6eec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6ee5 expref: 11 pid: 5834 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460315.286171:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fffce617 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875336482524672:0@lo:104: 00010000:00010000:0.0:1788460315.286204:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460315.286224:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460315.286229:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460315.286233:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005682bd4d/0x889bb893541b6f2b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460316.045581:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460316.177449:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482524928:0@lo:400: 00000100:00100000:3.0:1788460316.177522:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460316.177575:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460316.177581:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000022f0017 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482525056:0@lo:400: 00000100:00100000:3.0:1788460316.177622:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460316.177658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482524928 00000100:00100000:3.0:1788460316.177665:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482524928 00000100:00100000:3.0:1788460316.177709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788460316.177717:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006058af23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:3316:x1875336482524928:12345-0@lo:400: 00000100:00100000:3.0:1788460316.177762:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006058af23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:3316:x1875336482524928:12345-0@lo:400: Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460316.177769:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788460316.177805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525056 00000100:00100000:3.0:1788460316.177808:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525056 00000100:00100000:3.0:1788460316.177832:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460316.177837:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017d4eca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482525056:12345-0@lo:400: 00000100:00100000:3.0:1788460316.177867:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017d4eca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482525056:12345-0@lo:400: Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460316.177873:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788460316.180524:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000022f0017 x1875336482525056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460316.180545:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000022f0017 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482525056:0@lo:400: 00000100:00100000:3.0:1788460316.180556:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482524928:0@lo:400: 00010000:00010000:3.0:1788460317.068460:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460318.092532:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460319.128361:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460320.140903:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460321.178434:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460321.294879:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089ca752b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482525184:0@lo:400: 00000100:00100000:1.0:1788460321.294944:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460321.294992:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460321.294998:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005369b21b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482525312:0@lo:400: 00000100:00100000:1.0:1788460321.295022:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460321.295054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525184 00000100:00100000:1.0:1788460321.295061:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525184 00000100:00100000:1.0:1788460321.295103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460321.295110:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2606cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:3318:x1875336482525184:12345-0@lo:400: 00000100:00100000:1.0:1788460321.295156:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2606cf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:3318:x1875336482525184:12345-0@lo:400: Request processed in 47us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460321.295164:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460321.295214:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525312 00000100:00100000:1.0:1788460321.295218:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525312 00000100:00100000:1.0:1788460321.295254:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460321.295260:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eed9a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482525312:12345-0@lo:400: 00000100:00100000:1.0:1788460321.295318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eed9a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482525312:12345-0@lo:400: Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460321.295349:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788460321.295389:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005369b21b x1875336482525312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460321.295402:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005369b21b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482525312:0@lo:400: 00000100:00100000:1.0:1788460321.295412:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089ca752b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482525184:0@lo:400: 00000020:01000004:3.0:1788460322.098976:0:6697:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:3.0:1788460322.098980:0:6697:0:(obd_mount.c:1014:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788460322.099115:0:6697:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cc6f7a9c 00000020:01000004:3.0:1788460322.099132:0:6697:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788460322.099144:0:6697:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788460322.099162:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000e07ab452) 00000020:00000080:3.0:1788460322.099427:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788460322.157956:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788460322.159439:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788460322.180068:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788460322.186697:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788460322.186729:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788460322.186778:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788460322.186861:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788460322.187504:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788460322.187514:0:6697:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788460322.187522:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x889bb893541b6f39 00000020:01000004:3.0:1788460322.187530:0:6697:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788460322.187551:0:6697:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788460322.187554:0:6697:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788460322.187559:0:6697:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788460322.187563:0:6697:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788460322.187581:0:6697:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000002dcdf123) 00000020:00000080:3.0:1788460322.187593:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788460322.188709:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00010000:00010000:1.0:1788460322.188934:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460322.189418:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788460322.189425:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788460322.189877:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460322.189883:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788460322.190329:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460322.190335:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788460322.191744:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460322.192100:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788460322.192114:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788460322.192954:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788460322.192962:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788460322.212930:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460322.213400:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788460322.213407:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788460322.217558:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460322.217575:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788460322.220132:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460322.220147:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788460322.223839:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460322.224071:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788460322.224077:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788460322.224886:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788460322.224894:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788460322.256324:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460322.256514:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788460322.256520:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788460322.257708:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788460322.257716:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788460322.259829:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788460322.259880:0:6697:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788460322.259886:0:6697:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788460322.259887:0:6697:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788460322.259889:0:6697:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460322.259890:0:6697:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460322.259891:0:6697:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460322.259892:0:6697:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460322.259894:0:6697:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460322.259895:0:6697:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788460322.259896:0:6697:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788460322.259898:0:6697:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460322.259899:0:6697:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460322.259903:0:6697:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788460322.259906:0:6697:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460322.259907:0:6697:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788460322.259909:0:6697:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460322.259910:0:6697:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460322.259910:0:6697:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460322.259912:0:6697:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460322.259913:0:6697:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460322.259919:0:6697:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788460322.259920:0:6697:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788460322.259920:0:6697:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460322.259921:0:6697:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460322.259945:0:6697:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788460322.259960:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482525440:0@lo:253: 00000100:00100000:3.0:1788460322.260154:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.260327:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4e02ba5 going to sleep for 11 seconds 00000100:00100000:0.0:1788460322.260374:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525440 00000100:00100000:0.0:1788460322.260381:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525440 00000100:00100000:0.0:1788460322.260455:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788460322.260463:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d57478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482525440:12345-0@lo:253: 20000000:01000000:0.0:1788460322.260490:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788460322.260494:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788460322.260505:0:5836:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788460322.260508:0:5836:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788460322.261911:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460322.262399:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788460322.262414:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788460322.262454:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788460322.262463:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788460322.262492:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788460322.262540:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788460322.262985:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788460322.263004:0:5836:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:0.0:1788460322.263006:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:0.0:1788460322.263176:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788460322.263265:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788460322.263335:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788460322.263344:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:0.0:1788460322.263376:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788460322.263386:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788460322.263416:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788460322.263481:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788460322.264797:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788460322.264821:0:5836:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:0.0:1788460322.264823:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:0.0:1788460322.264861:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788460322.264869:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788460322.264900:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788460322.264907:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:0.0:1788460322.264950:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788460322.264958:0:5836:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788460322.264990:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788460322.265162:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788460322.265259:0:5836:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788460322.265269:0:5836:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788460322.265275:0:5836:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788460322.265277:0:5836:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788460322.265279:0:5836:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788460322.265304:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788460322.265308:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788460322.265343:0:5836:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788460322.265346:0:5836:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788460322.265889:0:6712:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788460322.265943:0:6712:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788460322.265995:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788460322.266770:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788460322.266819:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788460322.266896:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788460322.266912:0:5836:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788460322.266915:0:5836:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788460322.267569:0:6713:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788460322.267624:0:6713:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788460322.267675:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788460322.267997:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788460322.268156:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788460322.268263:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788460322.268277:0:5836:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788460322.268280:0:5836:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788460322.268616:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788460322.268803:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788460322.268839:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788460322.268893:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788460322.268909:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788460322.268925:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269135:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6e67 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269143:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6e83 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269149:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269166:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269226:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269240:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 11 pid: 5836 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.269368:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fffce617 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875336482525568:0@lo:104: 00000100:00100000:0.0:1788460322.269424:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460322.269521:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6e83 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269529:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6e83 expref: 11 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.269537:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c0c738c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875336482525696:0@lo:104: 00000100:00100000:0.0:1788460322.269559:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460322.269664:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6e67 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.269672:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6e67 expref: 11 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.269680:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ef16eec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875336482525824:0@lo:104: 00000100:00100000:0.0:1788460322.269717:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.269785:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525568 00000100:00100000:2.0:1788460322.269792:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525568 00000100:00100000:2.0:1788460322.269826:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525696 00000100:00100000:2.0:1788460322.269829:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525696 00000100:00100000:2.0:1788460322.269840:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460322.269846:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e92362e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5836:x1875336482525568:12345-0@lo:104: 00010000:00010000:2.0:1788460322.269858:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.269916:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460322.269922:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e92362e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5836:x1875336482525568:12345-0@lo:104: Request processed in 76us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.269930:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460322.269957:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460322.269963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6cc2b27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5836:x1875336482525696:12345-0@lo:104: 00010000:00010000:2.0:1788460322.269970:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270014:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460322.270018:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6cc2b27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5836:x1875336482525696:12345-0@lo:104: Request processed in 57us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.270024:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788460322.270041:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460322.270045:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270052:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008cd9d43a already unused, calling callback (00000000891224fe) 10000000:00010000:2.0:1788460322.270055:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270062:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460322.270068:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460322.270073:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460322.270099:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270106:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460322.270120:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270126:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: 000000008cd9d43a/0x889bb893541b6ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6efa expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270149:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460322.270151:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270156:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000050240aa8 already unused, calling callback (00000000891224fe) 10000000:00010000:2.0:1788460322.270163:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270169:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460322.270175:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460322.270202:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788460322.270211:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000579d2891 going to sleep for 11 seconds 00010000:00010000:2.0:1788460322.270216:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270221:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460322.270225:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270229:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: 0000000050240aa8/0x889bb893541b6e83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6e8a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.270231:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fffce617 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875336482525568:0@lo:104: 00010000:00010000:2.0:1788460322.270239:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460322.270240:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460322.270242:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460322.270246:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c0c738c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875336482525696:0@lo:104: 00000100:00100000:2.0:1788460322.270259:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482525952:0@lo:103: 00000100:00100000:2.0:1788460322.270303:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.270334:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460322.270339:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af8378bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482526080:0@lo:103: 00000100:00100000:2.0:1788460322.270359:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.270386:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525952 00000100:00100000:2.0:1788460322.270389:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525952 00010000:00010000:2.0:1788460322.270400:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 12 pid: 5836 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.270413:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526080 00000100:00100000:2.0:1788460322.270414:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526080 00010000:00010000:2.0:1788460322.270418:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6e83 expref: 13 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.270425:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460322.270428:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047277ad9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:3316:x1875336482525952:12345-0@lo:103: 00010000:00010000:2.0:1788460322.270434:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460322.270437:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 13 pid: 5836 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270442:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 13 pid: 5836 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270450:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ce0961b/0x889bb893541b6efa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6ef3 expref: 13 pid: 5836 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270459:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460322.270475:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047277ad9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:3316:x1875336482525952:12345-0@lo:103: Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.270479:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460322.270493:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460322.270496:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b816b92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:3316:x1875336482526080:12345-0@lo:103: 00010000:00010000:2.0:1788460322.270501:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460322.270503:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6e83 expref: 11 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270508:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6e83 expref: 11 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270513:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007027e822/0x889bb893541b6e8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6e83 expref: 11 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270519:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460322.270532:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b816b92 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:3316:x1875336482526080:12345-0@lo:103: Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.270536:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460322.270551:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af8378bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482526080:0@lo:103: 00000100:00100000:2.0:1788460322.270555:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482525952:0@lo:103: 00000100:00100000:2.0:1788460322.270568:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482525824 00000100:00100000:2.0:1788460322.270570:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482525824 00000100:00100000:2.0:1788460322.270578:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460322.270581:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058312b04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5836:x1875336482525824:12345-0@lo:104: 00010000:00010000:2.0:1788460322.270585:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270606:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460322.270608:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058312b04 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5836:x1875336482525824:12345-0@lo:104: Request processed in 28us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.270619:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788460322.270628:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460322.270630:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270634:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052a95aa1 already unused, calling callback (00000000891224fe) 10000000:00010000:2.0:1788460322.270635:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270639:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460322.270642:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460322.270645:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460322.270655:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270659:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460322.270667:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270671:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: 0000000052a95aa1/0x889bb893541b6e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6e6e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270679:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460322.270679:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460322.270680:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460322.270685:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482526208:0@lo:103: 00000100:00100000:2.0:1788460322.270706:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.270736:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526208 00000100:00100000:2.0:1788460322.270739:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526208 00010000:00010000:2.0:1788460322.270750:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6e67 expref: 10 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.270766:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460322.270771:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af8378bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:3318:x1875336482526208:12345-0@lo:103: 00010000:00010000:2.0:1788460322.270777:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460322.270780:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6e67 expref: 10 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270787:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6e67 expref: 10 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270796:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270803:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270814:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270820:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270825:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270831:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270842:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004f18ad3b already unused, calling callback (0000000012f50c03) 00010000:00010000:2.0:1788460322.270846:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270852:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270860:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270867:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460322.270894:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af8378bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:3318:x1875336482526208:12345-0@lo:103: Request processed in 123us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.270900:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460322.270926:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482526208:0@lo:103: 00010000:00010000:2.0:1788460322.270945:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6e6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6e67 expref: 9 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.270954:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ef16eec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1875336482525824:0@lo:104: 00010000:00010000:2.0:1788460322.270968:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270975:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270980:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.270985:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f18ad3b/0x889bb893541b6f47 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788460322.271004:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788460322.271354:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460322.299950:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d57478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+8:6697:x1875336482525440:12345-0@lo:253: Request processed in 39482us (39790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.299966:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788460322.300046:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3a3c6e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482525440:0@lo:253: 10000000:01000000:0.0:1788460322.300062:0:6697:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788460322.300066:0:6697:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788460322.300068:0:6697:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460322.300069:0:6697:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460322.300070:0:6697:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788460322.300071:0:6697:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460322.300072:0:6697:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460322.300074:0:6697:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460322.300075:0:6697:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788460322.300077:0:6697:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460322.300078:0:6697:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788460322.300097:0:6697:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000cc6f7a9c from lustre-OST0000 10000000:01000000:0.0:1788460322.300119:0:6697:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788460322.300122:0:6697:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788460322.300127:0:6697:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9650f6139800 10000000:01000000:0.0:1788460322.300132:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460322.300146:0:6697:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460322.304992:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460322.314395:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460322.314412:0:6697:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650f6139800 from 1 10000000:01000000:0.0:1788460322.314415:0:6697:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788460322.314456:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 00000000d490dc6e/0x889bb893541b6f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.314468:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 00000000d490dc6e/0x889bb893541b6f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.314478:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 00000000d490dc6e/0x889bb893541b6f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.314500:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526336:0@lo:101: 00000100:00100000:0.0:1788460322.314610:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.314704:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063838879 going to sleep for 11 seconds 00000100:00100000:1.0:1788460322.314746:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526336 00000100:00100000:1.0:1788460322.314753:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526336 00000100:00100000:1.0:1788460322.314850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788460322.314860:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089748a88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+8:6697:x1875336482526336:12345-0@lo:101: 00010000:00010000:1.0:1788460322.314872:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460322.314884:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000984894fd/0x889bb893541b6f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6f4e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.314906:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000984894fd/0x889bb893541b6f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6f4e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.314915:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000984894fd/0x889bb893541b6f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f4e expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.314923:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000984894fd, rc 0) 00000100:00100000:1.0:1788460322.314961:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089748a88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:6697:x1875336482526336:12345-0@lo:101: Request processed in 103us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.314975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788460322.315035:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526336:0@lo:101: 00010000:00010000:0.0:1788460322.315047:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 00000000d490dc6e/0x889bb893541b6f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.315055:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 00000000d490dc6e/0x889bb893541b6f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.315114:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526464:0@lo:501: 00000100:00100000:0.0:1788460322.315136:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.315236:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063838879 going to sleep for 11 seconds 00000100:00100000:2.0:1788460322.315360:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526464 00000100:00100000:2.0:1788460322.315366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526464 00000100:00100000:2.0:1788460322.315388:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460322.315393:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4df6ef5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:6697:x1875336482526464:12345-0@lo:501: 00000100:00100000:2.0:1788460322.315586:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4df6ef5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:6697:x1875336482526464:12345-0@lo:501: Request processed in 191us (448us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460322.315593:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788460322.315713:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526464:0@lo:501: 10000000:01000000:0.0:1788460322.315726:0:6697:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788460322.315766:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526592:0@lo:501: 00000100:00100000:0.0:1788460322.315790:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.315805:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063838879 going to sleep for 11 seconds 00000100:00100000:2.0:1788460322.315843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526592 00000100:00100000:2.0:1788460322.315848:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526592 00000100:00100000:2.0:1788460322.315865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460322.315870:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004dc8f48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:6697:x1875336482526592:12345-0@lo:501: 00000100:00100000:2.0:1788460322.315986:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004dc8f48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:6697:x1875336482526592:12345-0@lo:501: Request processed in 116us (195us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460322.315992:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788460322.316051:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526592:0@lo:501: 10000000:01000000:0.0:1788460322.316077:0:6697:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788460322.316095:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 00000000d490dc6e/0x889bb893541b6f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.316103:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 00000000d490dc6e/0x889bb893541b6f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460322.316112:0:6697:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9650f6139800 10000000:01000000:0.0:1788460322.316122:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788460322.316138:0:6697:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460322.316251:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460322.316258:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460322.316264:0:6697:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff9650d119e620 10000000:01000000:0.0:1788460322.316267:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788460322.316304:0:6697:0:(mgc_request.c:2266:mgc_process_log()) Process log nodemap-ffff9650d119e620 from 1 10000000:01000000:0.0:1788460322.316307:0:6697:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788460322.316328:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 000000009a14287f/0x889bb893541b6f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.316335:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 000000009a14287f/0x889bb893541b6f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.316343:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 000000009a14287f/0x889bb893541b6f5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.316354:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526720:0@lo:101: 00000100:00100000:0.0:1788460322.316379:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.316398:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000085dcb5b going to sleep for 11 seconds 00000100:00100000:2.0:1788460322.316555:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526720 00000100:00100000:2.0:1788460322.316560:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526720 00000100:00100000:2.0:1788460322.316577:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460322.316581:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe0711db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+9:6697:x1875336482526720:12345-0@lo:101: 00010000:00010000:2.0:1788460322.316589:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460322.316598:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008cd9d43a/0x889bb893541b6f63 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6f5c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.316614:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cd9d43a/0x889bb893541b6f63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6f5c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.316621:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008cd9d43a/0x889bb893541b6f63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f5c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.316633:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008cd9d43a, rc 0) 00000100:00100000:2.0:1788460322.316658:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe0711db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:6697:x1875336482526720:12345-0@lo:101: Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.316664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788460322.316741:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526720:0@lo:101: 00010000:00010000:0.0:1788460322.316752:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 000000009a14287f/0x889bb893541b6f5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f63 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.316759:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 000000009a14287f/0x889bb893541b6f5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6f63 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460322.316772:0:6697:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788460322.316785:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 000000009a14287f/0x889bb893541b6f5c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f63 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.316802:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 000000009a14287f/0x889bb893541b6f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f63 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460322.316809:0:6697:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788460322.316813:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460322.316834:0:6697:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460322.316882:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460322.316888:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460322.316893:0:6697:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9650f6139800 10000000:01000000:0.0:1788460322.316896:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788460322.316908:0:6697:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788460322.316910:0:6697:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788460322.316924:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 000000004f18ad3b/0x889bb893541b6f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.316930:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 000000004f18ad3b/0x889bb893541b6f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.316936:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 000000004f18ad3b/0x889bb893541b6f6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.316947:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526848:0@lo:101: 00000100:00100000:0.0:1788460322.316972:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.316984:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a91c0d95 going to sleep for 11 seconds 00000100:00100000:2.0:1788460322.317038:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526848 00000100:00100000:2.0:1788460322.317042:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526848 00000100:00100000:2.0:1788460322.317058:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460322.317063:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000118a9b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+10:6697:x1875336482526848:12345-0@lo:101: 00010000:00010000:2.0:1788460322.317069:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460322.317076:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000770dbd5b/0x889bb893541b6f71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6f6a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.317087:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000770dbd5b/0x889bb893541b6f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6f6a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.317094:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000770dbd5b/0x889bb893541b6f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f6a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.317100:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000770dbd5b, rc 0) 00000100:00100000:2.0:1788460322.317135:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000118a9b26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482526848:12345-0@lo:101: Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.317140:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788460322.317229:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526848:0@lo:101: 00010000:00010000:0.0:1788460322.317238:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 000000004f18ad3b/0x889bb893541b6f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.317254:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 000000004f18ad3b/0x889bb893541b6f6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460322.317324:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526976:0@lo:501: 00000100:00100000:0.0:1788460322.317348:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.317366:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a91c0d95 going to sleep for 11 seconds 00000100:00100000:2.0:1788460322.317468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482526976 00000100:00100000:2.0:1788460322.317473:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482526976 00000100:00100000:2.0:1788460322.317492:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460322.317497:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8a84bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482526976:12345-0@lo:501: 00000100:00100000:2.0:1788460322.317675:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8a84bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482526976:12345-0@lo:501: Request processed in 178us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.317687:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788460322.317752:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482526976:0@lo:501: 00000100:00100000:0.0:1788460322.317776:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527104:0@lo:503: 00000100:00100000:0.0:1788460322.317812:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.317834:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a91c0d95 going to sleep for 11 seconds 00000100:00100000:1.0:1788460322.317889:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482527104 00000100:00100000:1.0:1788460322.317894:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482527104 00000100:00100000:1.0:1788460322.317916:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788460322.317921:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cce7006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482527104:12345-0@lo:503: 00000100:00100000:1.0:1788460322.318059:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cce7006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482527104:12345-0@lo:503: Request processed in 138us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.318065:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788460322.318135:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527104:0@lo:503: 00000040:00080000:0.0:1788460322.318469:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460322.318538:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527232:0@lo:502: 00000100:00100000:0.0:1788460322.318575:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.318595:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a91c0d95 going to sleep for 11 seconds 00000100:00100000:2.0:1788460322.318653:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482527232 00000100:00100000:2.0:1788460322.318658:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482527232 00000100:00100000:2.0:1788460322.318676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788460322.318681:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc85e5c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482527232:12345-0@lo:502: 00000100:00100000:2.0:1788460322.318817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc85e5c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482527232:12345-0@lo:502: Request processed in 135us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.318823:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788460322.318898:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527232:0@lo:502: 00000040:00080000:0.0:1788460322.319127:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788460322.319172:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788460322.319243:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788460322.321424:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788460322.321513:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788460322.321573:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788460322.321619:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527360:0@lo:502: 00000100:00100000:0.0:1788460322.321690:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.321732:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a91c0d95 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.322101:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482527360 00000100:00100000:3.0:1788460322.322111:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482527360 00000100:00100000:3.0:1788460322.322165:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460322.322173:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b258110b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482527360:12345-0@lo:502: 00000100:00100000:3.0:1788460322.322515:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b258110b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482527360:12345-0@lo:502: Request processed in 343us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.322523:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788460322.323316:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc248707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527360:0@lo:502: 00000040:00080000:0.0:1788460322.323453:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788460322.323465:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788460322.324282:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788460322.324300:0:6716:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788460322.324306:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460322.324309:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788460322.324315:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788460322.324330:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000893c32f0) 00000020:00000080:0.0:1788460322.324349:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788460322.324355:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788460322.324411:0:6716:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000cc6f7a9c from lustre-OST0000, refs=2 00080000:01000000:0.0:1788460322.324419:0:6716:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788460322.324425:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x889bb893541b6f7f 00010000:00010000:0.0:1788460322.328162:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788460322.328557:0:6716:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788460322.331108:0:6716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788460322.331841:0:6716:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788460322.337742:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788460322.339224:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788460322.340709:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788460322.340719:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460322.340726:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460322.340728:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788460322.340731:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460322.340741:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460322.340743:0:6716:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788460322.340746:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788460322.340748:0:6716:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788460322.340798:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460322.340802:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460322.340803:0:6716:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788460322.340806:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788460322.340952:0:6697:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788460322.340965:0:6697:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788460322.341019:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 000000004f18ad3b/0x889bb893541b6f6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.341032:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 000000004f18ad3b/0x889bb893541b6f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460322.341039:0:6697:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650f6139800 from 1 10000000:01000000:2.0:1788460322.341042:0:6697:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460322.341076:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 0000000074126c31/0x889bb893541b6f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.341083:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 0000000074126c31/0x889bb893541b6f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.341092:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 0000000074126c31/0x889bb893541b6f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.341112:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527488:0@lo:101: 00000100:00100000:2.0:1788460322.341212:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.341264:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b697007 going to sleep for 11 seconds 00000100:00100000:1.0:1788460322.341393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482527488 00000100:00100000:1.0:1788460322.341400:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482527488 00000100:00100000:1.0:1788460322.341444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788460322.341453:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b43990f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+11:6697:x1875336482527488:12345-0@lo:101: 00010000:00010000:1.0:1788460322.341465:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460322.341476:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002092328d/0x889bb893541b6f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6f86 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.341497:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002092328d/0x889bb893541b6f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6f86 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.341506:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002092328d/0x889bb893541b6f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f86 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.341514:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002092328d, rc 0) 00000100:00100000:1.0:1788460322.341548:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b43990f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:6697:x1875336482527488:12345-0@lo:101: Request processed in 97us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.341555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788460322.341639:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527488:0@lo:101: 00010000:00010000:2.0:1788460322.341652:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 0000000074126c31/0x889bb893541b6f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.341660:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 0000000074126c31/0x889bb893541b6f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.342318:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527616:0@lo:256: 00000100:00100000:2.0:1788460322.342363:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.342399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482527616 00000100:00100000:2.0:1788460322.342404:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482527616 00000100:00100000:2.0:1788460322.342489:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788460322.342497:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000513009ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:6697:x1875336482527616:12345-0@lo:256: 20000000:01000000:2.0:1788460322.342511:0:5837:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788460322.343145:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788460322.343150:0:5837:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788460322.345522:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000513009ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:6697:x1875336482527616:12345-0@lo:256: Request processed in 3021us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.345536:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788460322.346566:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b697007 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.346602:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000922bd323 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527616:0@lo:256: 10000000:01000000:3.0:1788460322.347159:0:6697:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460322.347213:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: 0000000074126c31/0x889bb893541b6f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.347225:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: 0000000074126c31/0x889bb893541b6f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.347249:0:6697:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650f6139800 from 1 10000000:01000000:3.0:1788460322.347252:0:6697:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460322.347417:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6f94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.347426:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6f94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.347436:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6f94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.347454:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000022f0017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527744:0@lo:101: 00000100:00100000:3.0:1788460322.347504:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460322.348572:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482527744 00000100:00100000:1.0:1788460322.348584:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482527744 00000100:00100000:1.0:1788460322.348638:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460322.348645:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b14fc25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:6697:x1875336482527744:12345-0@lo:101: 00010000:00010000:1.0:1788460322.348660:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460322.348676:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6f9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6f94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.348699:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6f94 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.348710:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ad2e3cf/0x889bb893541b6f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f94 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.348717:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ad2e3cf, rc 0) 00000100:00100000:1.0:1788460322.348759:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b14fc25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482527744:12345-0@lo:101: Request processed in 115us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.348766:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788460322.352218:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 00000000126df779 going to sleep for 11 seconds 00000100:00100000:2.0:1788460322.352262:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000022f0017 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527744:0@lo:101: 00010000:00010000:2.0:1788460322.352307:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6f94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.352319:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: 00000000a932fca5/0x889bb893541b6f94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.352428:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527872:0@lo:501: 00000100:00100000:2.0:1788460322.352485:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.352514:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ef56dec going to sleep for 11 seconds 00000100:00100000:1.0:1788460322.352649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482527872 00000100:00100000:1.0:1788460322.352656:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482527872 00000100:00100000:1.0:1788460322.352704:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788460322.352713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e17a2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482527872:12345-0@lo:501: 00000100:00100000:1.0:1788460322.352941:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e17a2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482527872:12345-0@lo:501: Request processed in 229us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.352949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788460322.353107:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482527872:0@lo:501: 00000100:00100000:2.0:1788460322.353138:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528000:0@lo:503: 00000100:00100000:2.0:1788460322.353212:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.353235:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ef56dec going to sleep for 11 seconds 00000100:00100000:1.0:1788460322.353400:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528000 00000100:00100000:1.0:1788460322.353405:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528000 00000100:00100000:1.0:1788460322.353429:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788460322.353435:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ab1d1a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482528000:12345-0@lo:503: 00000100:00100000:1.0:1788460322.353651:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ab1d1a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482528000:12345-0@lo:503: Request processed in 216us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.353665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788460322.353802:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528000:0@lo:503: 00000040:00080000:2.0:1788460322.354038:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460322.354103:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528128:0@lo:502: 00000100:00100000:2.0:1788460322.354138:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.354381:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045d0a49b going to sleep for 11 seconds 00000100:00100000:1.0:1788460322.354446:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528128 00000100:00100000:1.0:1788460322.354451:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528128 00000100:00100000:1.0:1788460322.354649:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788460322.354659:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a188d24f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482528128:12345-0@lo:502: 00000100:00100000:1.0:1788460322.354843:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a188d24f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482528128:12345-0@lo:502: Request processed in 187us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.354851:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788460322.354923:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528128:0@lo:502: 00000040:00080000:2.0:1788460322.355216:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788460322.355282:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788460322.355323:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528256:0@lo:502: 00000100:00100000:2.0:1788460322.355360:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.355979:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045d0a49b going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.356057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528256 00000100:00100000:3.0:1788460322.356071:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528256 00000100:00100000:3.0:1788460322.356101:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788460322.356107:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fbfab79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482528256:12345-0@lo:502: 00000100:00100000:3.0:1788460322.356460:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fbfab79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482528256:12345-0@lo:502: Request processed in 352us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.356469:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788460322.356551:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000faac1449 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528256:0@lo:502: 00000040:00080000:2.0:1788460322.356654:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788460322.356666:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788460322.357095:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460322.357104:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460322.357106:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788460322.357118:0:6720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650f6139800 00000020:00000080:2.0:1788460322.357120:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788460322.357160:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460322.357249:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460322.357252:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788460322.357255:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788460322.357451:0:6697:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788460322.357460:0:6697:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460322.357483:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.357495:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.357534:0:6697:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788460322.357537:0:6697:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9650f6139800 10000000:01000000:3.0:1788460322.357540:0:6697:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9650f6139800 10000000:01000000:3.0:1788460322.357545:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460322.357557:0:6697:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788460322.357603:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788460322.357611:0:6697:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788460322.357622:0:6697:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650f6139800 from 1 10000000:01000000:3.0:1788460322.357625:0:6697:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788460322.357654:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.357663:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.357672:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.357697:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528384:0@lo:101: 00000100:00100000:3.0:1788460322.357742:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.357773:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528384 00000100:00100000:3.0:1788460322.357779:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528384 00000100:00100000:3.0:1788460322.357805:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460322.357812:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:6697:x1875336482528384:12345-0@lo:101: 00010000:00010000:3.0:1788460322.357823:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460322.357835:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6fa2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.357856:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.357865:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.357874:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5800, rc 0) 00000100:00100000:3.0:1788460322.357900:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528384:12345-0@lo:101: Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.357906:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460322.357943:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.357959:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528384:0@lo:101: 00010000:00010000:3.0:1788460322.357972:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.357981:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.358043:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528512:0@lo:501: 00000100:00100000:3.0:1788460322.358067:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.358086:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528512 00000100:00100000:3.0:1788460322.358090:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528512 00000100:00100000:3.0:1788460322.358105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788460322.358111:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528512:12345-0@lo:501: 00000100:00100000:2.0:1788460322.359373:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.360651:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528512:12345-0@lo:501: Request processed in 2534us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.360663:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788460322.360776:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528512:0@lo:501: 00000100:00100000:0.0:1788460322.360823:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528640:0@lo:503: 00000100:00100000:0.0:1788460322.360870:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.360903:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528640 00000100:00100000:0.0:1788460322.360909:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528640 00000100:00100000:0.0:1788460322.360948:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788460322.360957:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528640:12345-0@lo:503: 00000100:00100000:0.0:1788460322.361098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528640:12345-0@lo:503: Request processed in 141us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460322.361115:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788460322.361157:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460322.361205:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528640:0@lo:503: 00000040:00080000:0.0:1788460322.361562:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460322.361619:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528768:0@lo:502: 00000100:00100000:0.0:1788460322.361654:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.361675:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d831a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.362451:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528768 00000100:00100000:3.0:1788460322.362458:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528768 00000100:00100000:3.0:1788460322.362495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788460322.362502:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528768:12345-0@lo:502: 00000100:00100000:3.0:1788460322.362691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528768:12345-0@lo:502: Request processed in 188us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.362699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788460322.362804:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528768:0@lo:502: 00000040:00080000:0.0:1788460322.363082:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788460322.363133:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788460322.363214:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788460322.364438:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788460322.364503:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788460322.364549:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788460322.364570:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788460322.364585:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788460322.364622:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788460322.364643:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788460322.364659:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788460322.364692:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788460322.364713:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788460322.364738:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788460322.364784:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788460322.364815:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788460322.364844:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788460322.364881:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788460322.364912:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788460322.364961:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788460322.365010:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788460322.365056:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788460322.365089:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788460322.365143:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788460322.365404:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788460322.365441:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788460322.365470:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788460322.365487:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788460322.365526:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528896:0@lo:502: 00000100:00100000:0.0:1788460322.365597:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460322.365672:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d831a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.365702:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482528896 00000100:00100000:3.0:1788460322.365707:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482528896 00000100:00100000:3.0:1788460322.365786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788460322.365796:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528896:12345-0@lo:502: 00000100:00100000:3.0:1788460322.365993:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482528896:12345-0@lo:502: Request processed in 198us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.366001:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788460322.366083:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482528896:0@lo:502: 00000040:00080000:0.0:1788460322.366151:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788460322.366160:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788460322.366880:0:6721:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788460322.366896:0:6721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9650f5eb4c98) 00000020:00000080:2.0:1788460322.366915:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788460322.366985:0:6721:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650f6139800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788460322.366990:0:6721:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650f6139800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788460322.366992:0:6721:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650f6139800 3 00010000:00080000:2.0:1788460322.367022:0:6721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650f5c62800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1788460322.369523:0:6721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788460322.369775:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788460322.369812:0:6721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788460322.369825:0:6721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x889bb893541b6fb7 00000100:00080000:2.0:1788460322.369835:0:6721:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460322.369841:0:6721:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9650f5c62800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460322.369877:0:6721:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d0262300 x1875336482529024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460322.369903:0:6721:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788460322.370015:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460322.370030:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482529152:0@lo:400: 00000100:00100000:1.0:1788460322.370088:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460322.370132:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529152 00000100:00100000:1.0:1788460322.370138:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529152 00000100:00100000:1.0:1788460322.370206:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460322.370216:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482529152:12345-0@lo:400: 00000100:00100000:1.0:1788460322.370393:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482529152:12345-0@lo:400: Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.370401:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788460322.370441:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650d831dc00 x1875336482529152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460322.370453:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482529152:0@lo:400: 00000100:00100000:3.0:1788460322.370573:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482529024:0@lo:38: 00000100:00100000:3.0:1788460322.370606:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460322.370879:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529024 00000100:00100000:1.0:1788460322.370884:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529024 00000100:00100000:1.0:1788460322.370905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460322.370909:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875336482529024:12345-0@lo:38: 00010000:00080000:1.0:1788460322.370931:0:5843:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1788460322.370966:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x889bb893541b6fbe 00000004:00100000:1.0:1788460322.370979:0:5843:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788460322.371009:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9650fc7a5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460322.371051:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875336482529024:12345-0@lo:38: Request processed in 139us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460322.371058:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788460322.371088:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650d0262300 x1875336482529024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460322.371096:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788460322.371102:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788460322.371108:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788460322.371112:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788460322.371114:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5c62800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788460322.371119:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482529024:0@lo:38: 00000040:00080000:3.0:1788460322.371312:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788460322.371713:0:6697:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788460322.371727:0:6697:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788460322.371747:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460322.371758:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788460322.371809:0:6697:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788460322.371811:0:6697:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788460322.371813:0:6697:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460322.371814:0:6697:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460322.371816:0:6697:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460322.371817:0:6697:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460322.371818:0:6697:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460322.371823:0:6697:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788460322.371825:0:6697:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788460322.371826:0:6697:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460322.371828:0:6697:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788460322.371831:0:6697:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788460322.371833:0:6697:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788460322.371834:0:6697:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788460322.371835:0:6697:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460322.371836:0:6697:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460322.371837:0:6697:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460322.371838:0:6697:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460322.371839:0:6697:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460322.371840:0:6697:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788460322.371841:0:6697:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788460322.371841:0:6697:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460322.371842:0:6697:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788460322.371860:0:6697:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788460322.371874:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482529280:0@lo:253: 00000100:00100000:1.0:1788460322.371926:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460322.371959:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fdfc8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788460322.372417:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529280 00000100:00100000:1.0:1788460322.372425:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529280 00000100:00100000:1.0:1788460322.372601:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788460322.372613:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6697:x1875336482529280:12345-0@lo:253: 20000000:01000000:1.0:1788460322.372638:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788460322.372652:0:5837:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788460322.405771:0:5837:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788460322.405793:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788460322.405861:0:5858:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788460322.405865:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788460322.405886:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.405903:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c29f5a00/0x889bb893541b6f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f1d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.405910:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166e000/0x889bb893541b6f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f86 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.405917:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.405956:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166e000/0x889bb893541b6f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6f86 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.405970:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166e000/0x889bb893541b6f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6f86 expref: 14 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.405983:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482529408:0@lo:104: 00000100:00100000:3.0:1788460322.406052:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460322.406107:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c29f5a00/0x889bb893541b6f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6f1d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406115:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c29f5a00/0x889bb893541b6f24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6f1d expref: 14 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.406123:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482529536:0@lo:104: 00000100:00100000:3.0:1788460322.406144:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.406204:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.406230:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529408 00000100:00100000:3.0:1788460322.406237:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529408 00000100:00100000:3.0:1788460322.406279:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529536 00000100:00100000:3.0:1788460322.406283:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529536 00000100:00100000:3.0:1788460322.406310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460322.406317:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5858:x1875336482529408:12345-0@lo:104: 00010000:00010000:3.0:1788460322.406330:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406378:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788460322.406385:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5858:x1875336482529408:12345-0@lo:104: Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.406391:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460322.406407:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460322.406413:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5858:x1875336482529536:12345-0@lo:104: 00010000:00010000:3.0:1788460322.406421:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406453:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788460322.406458:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5858:x1875336482529536:12345-0@lo:104: Request processed in 46us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.406464:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788460322.406483:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460322.406488:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406495:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460322.406498:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406514:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460322.406521:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.406527:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788460322.406553:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406560:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460322.406577:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406583:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167e00/0x889bb893541b6f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f8d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406595:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460322.406598:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406603:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460322.406605:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406611:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460322.406616:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.406627:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788460322.406642:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406648:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460322.406653:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406660:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6f1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f24 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.406672:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460322.406674:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460322.406675:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460322.406683:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460322.406694:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482529664:0@lo:103: 00000100:00100000:3.0:1788460322.406721:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.406743:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460322.406749:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482529792:0@lo:103: 00000100:00100000:3.0:1788460322.406773:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.406802:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529664 00000100:00100000:3.0:1788460322.406805:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529664 00010000:00010000:3.0:1788460322.406822:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166e000/0x889bb893541b6f8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f86 expref: 15 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.406841:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529792 00000100:00100000:3.0:1788460322.406844:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529792 00010000:00010000:3.0:1788460322.407528:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c29f5a00/0x889bb893541b6f24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f1d expref: 16 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.407563:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460322.407573:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:3316:x1875336482529664:12345-0@lo:103: 00010000:00010000:3.0:1788460322.407584:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460322.407589:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166e000/0x889bb893541b6f8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f86 expref: 16 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407599:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166e000/0x889bb893541b6f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6f86 expref: 16 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407615:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460322.407656:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:3316:x1875336482529664:12345-0@lo:103: Request processed in 86us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.407662:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460322.407679:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460322.407685:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ea553c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:3316:x1875336482529792:12345-0@lo:103: 00010000:00010000:3.0:1788460322.407693:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460322.407697:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c29f5a00/0x889bb893541b6f24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f1d expref: 15 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407705:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c29f5a00/0x889bb893541b6f24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6f1d expref: 15 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407716:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407724:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788460322.407748:0:5828:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001883866s 00010000:00010000:3.0:1788460322.407753:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407760:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407767:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407773:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407779:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460322.407783:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407790:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407799:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.407809:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460322.407834:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ea553c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:3316:x1875336482529792:12345-0@lo:103: Request processed in 149us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.407840:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460322.407917:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482529792:0@lo:103: 00000100:00100000:3.0:1788460322.407926:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482529664:0@lo:103: 00010000:00010000:3.0:1788460322.407964:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166e000/0x889bb893541b6f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6f86 expref: 14 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.407973:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482529408:0@lo:104: 00010000:00010000:3.0:1788460322.407981:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c29f5a00/0x889bb893541b6f24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6f1d expref: 13 pid: 5834 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.407988:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482529536:0@lo:104: 00010000:00010000:3.0:1788460322.407999:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.408006:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.408012:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.408017:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fc5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.418848:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:6697:x1875336482529280:12345-0@lo:253: Request processed in 46228us (46912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460322.418864:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788460322.418989:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6697:1875336482529280:0@lo:253: 10000000:01000000:1.0:1788460322.419005:0:6697:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788460322.419009:0:6697:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788460322.419011:0:6697:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788460322.419012:0:6697:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460322.419013:0:6697:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460322.419015:0:6697:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460322.419016:0:6697:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460322.419017:0:6697:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460322.419097:0:6697:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788460322.419099:0:6697:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788460322.419100:0:6697:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460322.419102:0:6697:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788460322.419118:0:6697:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788460322.424802:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460322.424967:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788460322.425445:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460322.425585:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788460322.425790:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460322.425986:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788460322.427250:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:2.0:1788460322.488521:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460322.488529:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650f6139800 from 4 10000000:01000000:2.0:1788460322.488534:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460322.488580:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.488593:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460322.488604:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460322.488627:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482529920:0@lo:101: 00000100:00100000:2.0:1788460322.488688:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.488740:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c30aea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.488833:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482529920 00000100:00100000:3.0:1788460322.488840:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482529920 00000100:00100000:3.0:1788460322.488885:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460322.488894:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:5839:x1875336482529920:12345-0@lo:101: 00010000:00010000:3.0:1788460322.488907:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460322.488920:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6fcc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.488955:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6fcc expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.488963:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fcc expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.488972:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5000, rc 0) 00000100:00100000:3.0:1788460322.489012:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:5839:x1875336482529920:12345-0@lo:101: Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.489019:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460322.489139:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482529920:0@lo:101: 00010000:00010000:3.0:1788460322.489154:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489162:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.489307:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530048:0@lo:256: 00000100:00100000:3.0:1788460322.489337:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.489358:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.489371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530048 00000100:00100000:3.0:1788460322.489375:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530048 00000100:00100000:3.0:1788460322.489395:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460322.489401:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:5839:x1875336482530048:12345-0@lo:256: 20000000:01000000:3.0:1788460322.489415:0:5837:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460322.489430:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460322.489433:0:5837:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788460322.489510:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:5839:x1875336482530048:12345-0@lo:256: Request processed in 108us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.489517:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460322.489547:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530048:0@lo:256: 10000000:01000000:3.0:1788460322.489578:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460322.489585:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489592:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.489604:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788460322.489606:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650c5118800 from 21 10000000:01000000:3.0:1788460322.489608:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788460322.489624:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489631:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489639:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.489649:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530176:0@lo:101: 00000100:00100000:3.0:1788460322.489669:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.489681:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.489690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530176 00000100:00100000:3.0:1788460322.489693:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530176 00000100:00100000:3.0:1788460322.489707:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788460322.489712:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:5839:x1875336482530176:12345-0@lo:101: 00010000:00010000:3.0:1788460322.489723:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460322.489732:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6fda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489746:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6fda expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489754:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fda expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489761:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4a00, rc 0) 00000100:00100000:3.0:1788460322.489785:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482530176:12345-0@lo:101: Request processed in 73us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.489790:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788460322.489815:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530176:0@lo:101: 00010000:00010000:3.0:1788460322.489824:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.489831:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.489854:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530304:0@lo:501: 00000100:00100000:3.0:1788460322.489872:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.489882:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.489890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530304 00000100:00100000:3.0:1788460322.489893:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530304 00000100:00100000:3.0:1788460322.489906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788460322.489911:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482530304:12345-0@lo:501: 00000100:00100000:3.0:1788460322.491135:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482530304:12345-0@lo:501: Request processed in 1219us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.491144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788460322.491258:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530304:0@lo:501: 00000100:00100000:3.0:1788460322.491300:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530432:0@lo:503: 00000100:00100000:3.0:1788460322.491878:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.491909:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.491923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530432 00000100:00100000:3.0:1788460322.491928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530432 00000100:00100000:3.0:1788460322.491950:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788460322.491957:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482530432:12345-0@lo:503: 00000100:00100000:3.0:1788460322.492218:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482530432:12345-0@lo:503: Request processed in 260us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.492225:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788460322.492261:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530432:0@lo:503: 00000100:00100000:1.0:1788460322.514109:0:6725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6725:1875336482530560:0@lo:502: 00000100:00100000:1.0:1788460322.514202:0:6725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460322.514248:0:6725:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fdfc8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.517631:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530560 00000100:00100000:3.0:1788460322.517646:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530560 00000100:00100000:3.0:1788460322.517692:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460322.517700:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6725:x1875336482530560:12345-0@lo:502: 00000100:00100000:3.0:1788460322.517943:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6725:x1875336482530560:12345-0@lo:502: Request processed in 243us (3740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.517951:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460322.518023:0:6725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6725:1875336482530560:0@lo:502: 00000100:00100000:3.0:1788460322.518084:0:6725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6725:1875336482530688:0@lo:502: 00000100:00100000:3.0:1788460322.518129:0:6725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.518151:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530688 00000100:00100000:3.0:1788460322.518155:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530688 00000100:00100000:3.0:1788460322.518202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788460322.518209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6725:x1875336482530688:12345-0@lo:502: 00000100:00100000:3.0:1788460322.518340:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:6725:x1875336482530688:12345-0@lo:502: Request processed in 131us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.518347:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788460322.518389:0:6725:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.518402:0:6725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6725:1875336482530688:0@lo:502: 00000040:00080000:3.0:1788460322.518420:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788460322.518481:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788460322.518489:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788460322.518498:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.518509:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.518518:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460322.518520:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5118800 from 4 10000000:01000000:3.0:1788460322.518523:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460322.518544:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.518552:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.518562:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.518582:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530816:0@lo:101: 00000100:00100000:3.0:1788460322.518607:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.518623:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.518634:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530816 00000100:00100000:3.0:1788460322.518637:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530816 00000100:00100000:3.0:1788460322.518656:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460322.518662:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482530816:12345-0@lo:101: 00010000:00010000:3.0:1788460322.518670:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460322.518680:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6fe8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.518699:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.518709:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.518717:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4c00, rc 0) 00000100:00100000:3.0:1788460322.518745:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482530816:12345-0@lo:101: Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.518751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460322.518778:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530816:0@lo:101: 00010000:00010000:3.0:1788460322.518789:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.518797:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.518846:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530944:0@lo:256: 00000100:00100000:3.0:1788460322.518873:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.518886:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.518896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482530944 00000100:00100000:3.0:1788460322.518899:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482530944 00000100:00100000:3.0:1788460322.518913:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788460322.518918:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482530944:12345-0@lo:256: 20000000:01000000:3.0:1788460322.518931:0:5837:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460322.518947:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460322.518950:0:5837:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788460322.519021:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482530944:12345-0@lo:256: Request processed in 102us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.519028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788460322.519055:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482530944:0@lo:256: 10000000:01000000:3.0:1788460322.519093:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460322.519098:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.519105:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.519112:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788460322.519114:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788460322.519116:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788460322.519129:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.519144:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.519152:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.519163:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531072:0@lo:101: 00000100:00100000:3.0:1788460322.519212:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.519230:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.519241:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531072 00000100:00100000:3.0:1788460322.519244:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531072 00000100:00100000:3.0:1788460322.519262:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788460322.519268:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482531072:12345-0@lo:101: 00010000:00010000:3.0:1788460322.519274:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460322.519307:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b6ff6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.519324:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.519332:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.519339:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4800, rc 0) 00000100:00100000:3.0:1788460322.519367:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482531072:12345-0@lo:101: Request processed in 99us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.519373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788460322.519399:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531072:0@lo:101: 00010000:00010000:3.0:1788460322.519416:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.519423:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.519448:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531200:0@lo:501: 00000100:00100000:3.0:1788460322.519471:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.519483:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.519494:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531200 00000100:00100000:3.0:1788460322.519497:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531200 00000100:00100000:3.0:1788460322.519512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788460322.519518:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482531200:12345-0@lo:501: 00000100:00100000:3.0:1788460322.519725:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482531200:12345-0@lo:501: Request processed in 206us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.519732:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788460322.519759:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531200:0@lo:501: 00000100:00100000:3.0:1788460322.519783:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531328:0@lo:503: 00000100:00100000:3.0:1788460322.519819:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.519832:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.519844:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531328 00000100:00100000:3.0:1788460322.519847:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531328 00000100:00100000:3.0:1788460322.519864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788460322.519869:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482531328:12345-0@lo:503: 00000100:00100000:3.0:1788460322.520000:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482531328:12345-0@lo:503: Request processed in 129us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.520006:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788460322.520047:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531328:0@lo:503: 00000100:00100000:3.0:1788460322.533873:0:6726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6726:1875336482531456:0@lo:502: 00000100:00100000:2.0:1788460322.535497:0:6726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.535898:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531456 00000100:00100000:3.0:1788460322.535906:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531456 00000100:00100000:3.0:1788460322.535962:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788460322.535971:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:6726:x1875336482531456:12345-0@lo:502: 00000100:00100000:1.0:1788460322.536302:0:6726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.537467:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:6726:x1875336482531456:12345-0@lo:502: Request processed in 1492us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.537478:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788460322.537582:0:6726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6726:1875336482531456:0@lo:502: 00000020:01000000:1.0:1788460322.537617:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460322.537625:0:6726:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788460322.537632:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460322.537634:0:6726:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788460322.537640:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788460322.537643:0:6726:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:1.0:1788460322.537664:0:6726:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788460322.537667:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460322.537687:0:6726:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff964fc2270000) 00000020:00000080:1.0:1788460322.537706:0:6726:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788460322.537712:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788460322.538043:0:6726:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788460322.538050:0:6726:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788460322.538056:0:6726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b700b 00010000:00080000:1.0:1788460322.538092:0:6726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964fc13c6800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1788460322.538536:0:6726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788460322.599018:0:6726:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788460322.599573:0:6726:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788460322.601353:0:6726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460322.603009:0:6726:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460322.603107:0:6726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788460322.603159:0:6726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788460322.604260:0:6727:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788460322.604265:0:6727:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788460322.605974:0:6726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788460322.605987:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788460322.606048:0:6726:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788460322.606081:0:6726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b7012 00000100:00080000:1.0:1788460322.606091:0:6726:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460322.606098:0:6726:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff964fc13c6800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460322.606137:0:6726:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d831c000 x1875336482531584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460322.606206:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482531584:0@lo:8: 00000100:00100000:1.0:1788460322.606282:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460322.606372:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531584 00000100:00100000:1.0:1788460322.606379:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531584 00000100:00100000:1.0:1788460322.606407:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460322.606414:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1875336482531584:12345-0@lo:8: 00000100:00100000:1.0:1788460322.606622:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1875336482531584:12345-0@lo:8: Request processed in 206us (339us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788460322.606629:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460322.606662:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788460322.606668:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc13c6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460322.606679:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788460322.606682:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482531584:0@lo:8: 00000100:00080000:1.0:1788460322.606706:0:6726:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788460322.606758:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460322.606763:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460322.606765:0:6726:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788460322.606768:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460322.606772:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460322.606776:0:6726:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788460322.606779:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788460322.606781:0:6726:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788460322.606806:0:6726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6726:1875336482531712:0@lo:502: 00000100:00100000:1.0:1788460322.606852:0:6726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460322.606876:0:6726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fdfc8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460322.607023:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531712 00000100:00100000:0.0:1788460322.607029:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531712 00000100:00100000:0.0:1788460322.607061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788460322.607070:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:6726:x1875336482531712:12345-0@lo:502: 00000100:00100000:0.0:1788460322.607299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:6726:x1875336482531712:12345-0@lo:502: Request processed in 218us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460322.607306:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788460322.607559:0:6726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6726:1875336482531712:0@lo:502: 00000020:01000000:1.0:1788460322.607581:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460322.607585:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460322.607587:0:6726:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788460322.607591:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788460322.608496:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788460322.608507:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788460322.608517:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.608528:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.608537:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788460322.608540:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5118800 from 1 10000000:01000000:3.0:1788460322.608542:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460322.608569:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.608577:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.608586:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.608615:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531840:0@lo:101: 00000100:00100000:3.0:1788460322.608657:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.608691:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d105d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.608717:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531840 00000100:00100000:3.0:1788460322.608722:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531840 00000100:00100000:3.0:1788460322.608916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788460322.608926:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482531840:12345-0@lo:101: 00010000:00010000:3.0:1788460322.608939:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460322.608951:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.608973:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7019 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.609040:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7019 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.609049:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5400, rc 0) 00000100:00100000:3.0:1788460322.609082:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482531840:12345-0@lo:101: Request processed in 158us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.609088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788460322.609570:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531840:0@lo:101: 00010000:00010000:3.0:1788460322.609585:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.609594:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.609641:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531968:0@lo:501: 00000100:00100000:3.0:1788460322.609669:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.609691:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d105d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.609709:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482531968 00000100:00100000:3.0:1788460322.609714:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482531968 00000100:00100000:3.0:1788460322.609913:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788460322.609921:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482531968:12345-0@lo:501: 00000100:00100000:3.0:1788460322.610154:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482531968:12345-0@lo:501: Request processed in 233us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.610161:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788460322.610207:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482531968:0@lo:501: 00000100:00100000:3.0:1788460322.610233:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482532096:0@lo:503: 00000100:00100000:3.0:1788460322.610269:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.610282:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d105d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.610310:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532096 00000100:00100000:3.0:1788460322.610314:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532096 00000100:00100000:3.0:1788460322.610334:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788460322.610340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482532096:12345-0@lo:503: 00000100:00100000:3.0:1788460322.610623:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482532096:12345-0@lo:503: Request processed in 282us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.610630:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788460322.610664:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482532096:0@lo:503: 00000100:00100000:2.0:1788460322.611843:0:6729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6729:1875336482532224:0@lo:502: 00000100:00100000:2.0:1788460322.611900:0:6729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.611993:0:6729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c30aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.612100:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532224 00000100:00100000:3.0:1788460322.612105:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532224 00000100:00100000:3.0:1788460322.612150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788460322.612159:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:6729:x1875336482532224:12345-0@lo:502: 00000100:00100000:3.0:1788460322.613342:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:6729:x1875336482532224:12345-0@lo:502: Request processed in 1171us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.613351:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788460322.613609:0:6729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6729:1875336482532224:0@lo:502: 00000020:01000000:2.0:1788460322.613641:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460322.613650:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460322.613653:0:6729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788460322.613667:0:6729:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650c5118800 00000020:00000080:2.0:1788460322.613670:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788460322.613701:0:6729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6729:1875336482532352:0@lo:502: 00000100:00100000:2.0:1788460322.613746:0:6729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460322.613788:0:6729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c30aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.614335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532352 00000100:00100000:3.0:1788460322.614342:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532352 00000100:00100000:3.0:1788460322.614389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788460322.614398:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:6729:x1875336482532352:12345-0@lo:502: 00000100:00100000:3.0:1788460322.614589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:6729:x1875336482532352:12345-0@lo:502: Request processed in 192us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460322.614598:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460322.615212:0:6729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:6729:1875336482532352:0@lo:502: 00000020:01000000:0.0:1788460322.615244:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460322.615251:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460322.615253:0:6729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788460322.615257:0:6729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788460322.615373:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788460322.615381:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460322.615390:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.615401:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460322.615411:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788460322.615413:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650c5118800 from 1 10000000:01000000:3.0:1788460322.615416:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788460322.615443:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.615450:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.615471:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.615491:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482532480:0@lo:101: 00000100:00100000:3.0:1788460322.615528:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.615562:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d2cc8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460322.616043:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532480 00000100:00100000:0.0:1788460322.616057:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532480 00000100:00100000:0.0:1788460322.616094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460322.616102:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482532480:12345-0@lo:101: 00010000:00010000:0.0:1788460322.616113:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460322.616125:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7027 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.616148:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7027 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.616158:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7027 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460322.616166:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c0030800, rc 0) 00000100:00100000:0.0:1788460322.616228:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482532480:12345-0@lo:101: Request processed in 127us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460322.616234:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788460322.616803:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482532480:0@lo:101: 00010000:00010000:3.0:1788460322.616819:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.616829:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460322.616867:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482532608:0@lo:501: 00000100:00100000:3.0:1788460322.616900:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460322.616920:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d2cc8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788460322.616934:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532608 00000100:00100000:3.0:1788460322.616937:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532608 00000100:00100000:3.0:1788460322.616973:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788460322.616981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482532608:12345-0@lo:501: 00000100:00100000:3.0:1788460322.618932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482532608:12345-0@lo:501: Request processed in 1946us (2025us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460322.618944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788460322.619012:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482532608:0@lo:501: 10000000:01000000:3.0:1788460322.620126:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788460322.620138:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460322.620157:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788460322.633737:0:6697:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788460322.633744:0:6697:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788460322.633783:0:6697:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788460322.633809:0:6697:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788460323.215420:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460324.236750:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460325.260383:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460326.286296:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460327.311465:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460327.953138:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460327.953157:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482532736:0@lo:400: 00000100:00100000:2.0:1788460327.953240:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788460327.953477:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460327.953482:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788460327.953484:0:38:0:(import.c:65:import_set_state_nolock()) ffff964fc13c6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460327.953492:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff964fc13c6800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460327.953577:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d831d500 x1875336482533120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460327.953629:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482532992:0@lo:400: 00000100:00100000:3.0:1788460327.953995:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532736 00000100:00100000:3.0:1788460327.954003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532736 00000100:00100000:3.0:1788460327.954046:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788460327.954055:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3319:x1875336482532736:12345-0@lo:400: 00000100:00100000:3.0:1788460327.954104:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3319:x1875336482532736:12345-0@lo:400: Request processed in 50us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460327.954112:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788460327.954435:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460327.954483:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482533120:0@lo:8: 00000100:00100000:1.0:1788460327.954581:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460327.954787:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482533120 00000100:00100000:1.0:1788460327.954792:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482533120 00000100:00100000:1.0:1788460327.954815:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460327.954820:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3315:x1875336482533120:12345-0@lo:8: 00010000:00080000:1.0:1788460327.954841:0:6701:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1788460327.954867:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b7035 00002000:00100000:1.0:1788460327.954905:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9650c7cf8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788460327.954909:0:6701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788460327.954920:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788460327.955023:0:6701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788460327.955586:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460327.955598:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482532864:0@lo:400: 00000100:00100000:2.0:1788460327.955637:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460327.955934:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482532736:0@lo:400: 00002000:00080000:1.0:1788460327.956422:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788460327.956452:0:6701:0:(import.c:65:import_set_state_nolock()) ffff9650c7cff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460327.956581:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532992 00000100:00100000:2.0:1788460327.956586:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532992 00000100:00100000:2.0:1788460327.956631:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482532864 00000100:00100000:2.0:1788460327.956634:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482532864 00000100:00100000:2.0:1788460327.956649:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460327.957810:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788460327.957822:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788460327.958022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482532992:12345-0@lo:400: 00000100:00100000:2.0:1788460327.958107:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482532992:12345-0@lo:400: Request processed in 1449us (3671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460327.958115:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460327.958135:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460327.958142:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482532864:12345-0@lo:400: 00000100:00100000:2.0:1788460327.958202:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482532864:12345-0@lo:400: Request processed in 61us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460327.958209:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788460327.958246:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d831fb80 x1875336482532864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460327.958270:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482532864:0@lo:400: 00000100:00100000:1.0:1788460327.958383:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875336482533120:12345-0@lo:8: Request processed in 3561us (3800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460327.958391:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788460327.958421:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d831d500 x1875336482533120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460327.958434:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788460327.958441:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788460327.958445:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788460327.958447:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc13c6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788460327.958460:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788460327.958464:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482533120:0@lo:8: 00000100:00080000:1.0:1788460327.958484:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788460327.958753:0:6727:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788460327.958925:0:6727:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 201194745549ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788460327.961497:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d831ed80 x1875336482532992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460327.961523:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482532992:0@lo:400: 00000004:00080000:0.0:1788460328.102437:0:6728:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788460328.102456:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482533248:0@lo:13: 00000100:00100000:0.0:1788460328.102463:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533376:0@lo:7: 00000004:00080000:1.0:1788460328.105256:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788460328.110790:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460328.110846:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788460328.110885:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482533376 00000100:00100000:0.0:1788460328.110893:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482533376 00000100:00100000:0.0:1788460328.110946:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460328.110956:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6728:x1875336482533376:12345-0@lo:7: 00000100:00100000:2.0:1788460328.112632:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460328.112717:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482533248 00000100:00100000:2.0:1788460328.112724:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482533248 00000100:00100000:2.0:1788460328.112766:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460328.112775:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482533248:12345-0@lo:13: 00002000:00000024:2.0:1788460328.112800:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788460328.113383:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482533248:12345-0@lo:13: Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460328.113392:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788460328.113439:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3e680 x1875336482533248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460328.113459:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482533248:0@lo:13: 00000100:00080000:1.0:1788460328.119380:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788460328.124754:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788460328.124768:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788460328.124861:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6728:x1875336482533376:12345-0@lo:7: Request processed in 13902us (14071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460328.124882:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788460328.125569:0:6728:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3ca80 x1875336482533376/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788460344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460328.125585:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533376:0@lo:7: 00000004:00080000:1.0:1788460328.125599:0:6728:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788460328.125640:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533504:0@lo:5: 00000100:00100000:1.0:1788460328.125679:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460328.125729:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92a06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460328.125834:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482533504 00000100:00100000:0.0:1788460328.125841:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482533504 00000100:00100000:0.0:1788460328.125938:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460328.125947:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6728:x1875336482533504:12345-0@lo:5: 00002000:00080000:0.0:1788460328.125974:0:6701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788460328.125977:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788460328.126282:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6728:x1875336482533504:12345-0@lo:5: Request processed in 335us (601us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788460328.126290:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788460328.132365:0:6728:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d831d500 x1875336482533504/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460328.132386:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533504:0@lo:5: 00000004:00080000:3.0:1788460328.132402:0:6728:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788460328.132443:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533632:0@lo:700: 00000100:00100000:3.0:1788460328.132498:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460328.132545:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460328.132569:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482533632 00000100:00100000:0.0:1788460328.132576:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482533632 00000100:00100000:0.0:1788460328.132622:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460328.132632:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6728:x1875336482533632:12345-0@lo:700: 00000100:00100000:0.0:1788460328.132671:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1875336482533760:0@lo:700: 00000100:00100000:0.0:1788460328.132704:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460328.132720:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460328.132743:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482533760 00000100:00100000:0.0:1788460328.132746:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482533760 00000100:00100000:0.0:1788460328.132770:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460328.132777:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1875336482533760:12345-0@lo:700: 40000000:02000000:0.0:1788460328.170896:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788460328.178010:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1875336482533760:12345-0@lo:700: Request processed in 45223us (45294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460328.178028:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788460328.178229:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3df80 x1875336482533760/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788460344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460328.178244:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1875336482533760:0@lo:700: 40000000:02000000:0.0:1788460328.178267:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:2.0:1788460328.335225:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788460328.344847:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788460328.344868:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788460328.344908:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6728:x1875336482533632:12345-0@lo:700: Request processed in 212273us (212405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460328.344934:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788460328.344939:0:6728:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8d180 x1875336482533632/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788460344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460328.344954:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533632:0@lo:700: 00000004:02000040:3.0:1788460328.409558:0:6728:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788460328.424579:0:6728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533888:0@lo:5: 00000100:00100000:3.0:1788460328.424645:0:6728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460328.424704:0:6728:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460328.426073:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482533888 00000100:00100000:1.0:1788460328.426083:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482533888 00000100:00100000:1.0:1788460328.427159:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460328.427171:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6728:x1875336482533888:12345-0@lo:5: 00002000:00080000:1.0:1788460328.450067:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788460328.450086:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788460328.459354:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6728:x1875336482533888:12345-0@lo:5: Request processed in 32176us (34699us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788460328.459370:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788460328.466988:0:6728:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8f800 x1875336482533888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460328.467005:0:6728:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788460328.467023:0:6728:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff965101d8f800 x1875336482533888/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460344 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460328.467033:0:6728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6728:1875336482533888:0@lo:5: 00000004:00080000:3.0:1788460328.467047:0:6728:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:3.0:1788460329.051658:0:7073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788460329.363981:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460330.380457:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460331.409668:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460332.429392:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460333.071400:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482534016:0@lo:400: 00000100:00100000:2.0:1788460333.071434:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482534144:0@lo:400: 00000100:00100000:0.0:1788460333.071476:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460333.071485:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460333.071553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534016 00000100:00100000:3.0:1788460333.071561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534016 00000100:00100000:0.0:1788460333.071566:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482534272:0@lo:400: 00000100:00100000:0.0:1788460333.071602:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460333.071606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788460333.071615:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3318:x1875336482534016:12345-0@lo:400: 00000100:00100000:3.0:1788460333.071663:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3318:x1875336482534016:12345-0@lo:400: Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460333.071670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788460333.071708:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460333.071715:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482534400:0@lo:400: 00000100:00100000:0.0:1788460333.071740:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460333.071783:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534144 00000100:00100000:0.0:1788460333.071787:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534144 00000100:00100000:0.0:1788460333.071819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534272 00000100:00100000:0.0:1788460333.071823:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534272 00000100:00100000:3.0:1788460333.071824:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534400 00000100:00100000:3.0:1788460333.071830:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534400 00000100:00100000:0.0:1788460333.071863:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460333.071870:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460333.071875:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482534144:12345-0@lo:400: 00000100:00100000:3.0:1788460333.071883:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482534400:12345-0@lo:400: 00000100:00100000:0.0:1788460333.071923:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482534144:12345-0@lo:400: Request processed in 51us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460333.071931:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460333.071937:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482534400:12345-0@lo:400: Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460333.071948:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460333.071955:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460333.071961:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482534272:12345-0@lo:400: 00000100:00100000:0.0:1788460333.071992:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482534272:12345-0@lo:400: Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460333.071998:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788460333.072018:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460333.072021:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460333.072043:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482534016:0@lo:400: 00010000:00080000:0.0:1788460333.072075:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8f100 x1875336482534400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460333.072086:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482534400:0@lo:400: 00010000:00080000:0.0:1788460333.072094:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8d500 x1875336482534272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460333.072102:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482534272:0@lo:400: 00010000:00080000:2.0:1788460333.072757:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8ed80 x1875336482534144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460333.072770:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482534144:0@lo:400: 00010000:00010000:0.0:1788460333.452424:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460333.622640:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482534528:0@lo:13: 00000100:00100000:3.0:1788460333.622806:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460333.622930:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534528 00000100:00100000:2.0:1788460333.622939:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534528 00000100:00100000:2.0:1788460333.622979:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460333.622988:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482534528:12345-0@lo:13: 00002000:00000024:2.0:1788460333.624738:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460333.624821:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482534528:12345-0@lo:13: Request processed in 1830us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460333.624831:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788460333.624907:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8c380 x1875336482534528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460333.624927:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482534528:0@lo:13: 00000001:00080000:3.0:1788460333.704899:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788460334.481253:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460335.502368:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460336.524291:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460337.550493:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460338.188540:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482534656:0@lo:400: 00000100:00100000:3.0:1788460338.188609:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460338.188757:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534656 00000100:00100000:1.0:1788460338.188765:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534656 00000100:00100000:1.0:1788460338.188822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788460338.188831:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3319:x1875336482534656:12345-0@lo:400: 00000100:00100000:1.0:1788460338.188908:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3319:x1875336482534656:12345-0@lo:400: Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460338.188915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788460338.189269:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482534656:0@lo:400: 00000100:00100000:0.0:1788460338.190629:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482534784:0@lo:400: 00000100:00100000:0.0:1788460338.190687:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460338.190717:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460338.190723:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482534912:0@lo:400: 00000100:00100000:0.0:1788460338.190745:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460338.190780:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534784 00000100:00100000:0.0:1788460338.190786:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534784 00000100:00100000:3.0:1788460338.190843:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788460338.190861:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482535040:0@lo:400: 00000100:00100000:3.0:1788460338.190896:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460338.190978:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535040 00000100:00100000:1.0:1788460338.190983:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535040 00000100:00100000:1.0:1788460338.191031:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460338.191040:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482535040:12345-0@lo:400: 00000100:00100000:1.0:1788460338.191088:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482535040:12345-0@lo:400: Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460338.191111:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788460338.191168:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3d180 x1875336482535040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460338.191201:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788460338.191217:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482535040:0@lo:400: 00000100:00100000:0.0:1788460338.195536:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482534912 00000100:00100000:0.0:1788460338.195550:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482534912 00000100:00100000:0.0:1788460338.195618:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460338.195628:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482534784:12345-0@lo:400: 00000100:00100000:0.0:1788460338.195716:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482534784:12345-0@lo:400: Request processed in 90us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460338.195723:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788460338.195764:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3dc00 x1875336482534784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460338.195779:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482534784:0@lo:400: 00000100:00100000:0.0:1788460338.195823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460338.195831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482534912:12345-0@lo:400: 00000100:00100000:0.0:1788460338.195866:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482534912:12345-0@lo:400: Request processed in 36us (5121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460338.195872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788460338.195889:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460338.195893:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788460338.195910:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3ce00 x1875336482534912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460338.195920:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482534912:0@lo:400: 00010000:00010000:2.0:1788460338.580249:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460338.701690:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482535168:0@lo:13: 00000100:00100000:3.0:1788460338.701756:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460338.701832:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535168 00000100:00100000:3.0:1788460338.701840:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535168 00000100:00100000:3.0:1788460338.701896:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788460338.701906:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482535168:12345-0@lo:13: 00002000:00000024:3.0:1788460338.701940:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460338.701982:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482535168:12345-0@lo:13: Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460338.701989:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788460338.702030:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8f800 x1875336482535168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460338.702054:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482535168:0@lo:13: 00010000:00010000:3.0:1788460339.596580:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460340.626536:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460341.646054:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788460341.965612:0:7652:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:1.0:1788460341.965615:0:7652:0:(obd_mount.c:1014:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788460341.965724:0:7652:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9650efb15800 00000020:01000004:1.0:1788460341.965739:0:7652:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788460341.965751:0:7652:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788460341.965764:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff964fc2276620) 00000020:00000080:1.0:1788460341.965779:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788460341.986637:0:7652:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788460341.986941:0:7652:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788460342.016963:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788460342.024320:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788460342.024361:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788460342.024657:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788460342.024691:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788460342.025228:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788460342.025474:0:7652:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788460342.025550:0:7652:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x889bb893541b7043 00000020:01000004:3.0:1788460342.025560:0:7652:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788460342.025586:0:7652:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788460342.025589:0:7652:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788460342.025595:0:7652:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788460342.025627:0:7652:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.132@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788460342.025631:0:7652:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788460342.025633:0:7652:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460342.025634:0:7652:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460342.025635:0:7652:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460342.025637:0:7652:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460342.025638:0:7652:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460342.025640:0:7652:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460342.025641:0:7652:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788460342.025643:0:7652:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788460342.025644:0:7652:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460342.025646:0:7652:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460342.025649:0:7652:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788460342.025651:0:7652:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460342.025652:0:7652:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460342.025654:0:7652:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460342.025660:0:7652:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460342.025661:0:7652:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460342.025662:0:7652:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460342.025663:0:7652:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460342.025664:0:7652:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788460342.025665:0:7652:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788460342.025666:0:7652:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460342.025667:0:7652:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460342.025702:0:7652:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788460342.025719:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482535296:0@lo:253: 00000100:00100000:3.0:1788460342.025788:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.025966:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92a0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460342.026172:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535296 00000100:00100000:0.0:1788460342.026302:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535296 00000100:00100000:0.0:1788460342.026399:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460342.026418:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:7652:x1875336482535296:12345-0@lo:253: 20000000:01000000:0.0:1788460342.026448:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788460342.026452:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788460342.026456:0:5834:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788460342.026460:0:5834:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788460342.028593:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460342.028877:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788460342.028894:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788460342.028940:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788460342.028949:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788460342.028983:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788460342.029112:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788460342.030917:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788460342.030947:0:5834:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:0.0:1788460342.030960:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:0.0:1788460342.031002:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788460342.031011:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788460342.031132:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788460342.031141:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:0.0:1788460342.031390:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788460342.031402:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788460342.031622:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788460342.031699:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788460342.033012:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788460342.033104:0:5834:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.203.132@tcp 20000000:01000000:0.0:1788460342.033108:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.203.132@tcp (null) (null) (null) 00000040:00080000:0.0:1788460342.033150:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788460342.033167:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788460342.034017:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788460342.034134:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.132@tcp (null) (null) 00000040:00080000:0.0:1788460342.034389:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788460342.034401:0:5834:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788460342.034614:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788460342.034653:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788460342.034674:0:5834:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788460342.034677:0:5834:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788460342.034683:0:5834:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788460342.034684:0:5834:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788460342.034686:0:5834:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788460342.034698:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788460342.034700:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788460342.034742:0:5834:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788460342.034744:0:5834:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788460342.035982:0:7654:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788460342.036117:0:7654:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788460342.036566:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788460342.036966:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788460342.037007:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788460342.037141:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788460342.037615:0:5834:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788460342.037619:0:5834:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788460342.038621:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788460342.038979:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788460342.039025:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788460342.039567:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788460342.039587:0:5834:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788460342.039590:0:5834:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788460342.040910:0:7656:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788460342.040986:0:7656:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788460342.041115:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788460342.044921:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788460342.044989:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788460342.045094:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788460342.045112:0:5834:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788460342.045115:0:5834:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788460342.046987:0:7657:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788460342.047161:0:7657:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788460342.047572:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788460342.048026:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788460342.048141:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788460342.048644:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788460342.048668:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788460342.048689:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048707:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166ec00/0x889bb893541b6f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f4e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048716:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102166200/0x889bb893541b6f71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f6a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048724:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048730:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fda expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048737:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048744:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7027 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048750:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 9/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048789:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7027 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.048890:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7027 expref: 18 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.048906:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0260000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535424:0@lo:104: 00000100:00100000:2.0:1788460342.048973:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460342.049069:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.049077:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 18 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.049085:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535552:0@lo:104: 00010000:00010000:2.0:1788460342.049109:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6fda expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.049117:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6fda expref: 18 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.049125:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535680:0@lo:104: 00010000:00010000:2.0:1788460342.049148:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.049165:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 18 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.049174:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535808:0@lo:104: 00010000:00010000:2.0:1788460342.049370:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102166200/0x889bb893541b6f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6f6a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.049391:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff965102166200/0x889bb893541b6f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6f6a expref: 18 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.049400:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535936:0@lo:104: 00010000:00010000:2.0:1788460342.049438:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166ec00/0x889bb893541b6f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6f4e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.049447:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166ec00/0x889bb893541b6f55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6f4e expref: 18 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.049455:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482536064:0@lo:104: 00000100:00100000:2.0:1788460342.049472:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.049939:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788460342.049961:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.050022:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.050140:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.050166:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535424 00000100:00100000:0.0:1788460342.050174:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535424 00000100:00100000:0.0:1788460342.050396:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535552 00000100:00100000:0.0:1788460342.050401:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535552 00000100:00100000:0.0:1788460342.050424:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535680 00000100:00100000:0.0:1788460342.050427:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535680 00000100:00100000:0.0:1788460342.050440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460342.050448:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d084d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5834:x1875336482535424:12345-0@lo:104: 00010000:00010000:0.0:1788460342.050462:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.050535:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460342.050540:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d084d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5834:x1875336482535424:12345-0@lo:104: Request processed in 94us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.050548:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460342.050585:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460342.050591:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5834:x1875336482535552:12345-0@lo:104: 00010000:00010000:0.0:1788460342.050599:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.050633:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788460342.050647:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5834:x1875336482535552:12345-0@lo:104: Request processed in 56us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.050653:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460342.050667:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460342.050673:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5834:x1875336482535680:12345-0@lo:104: 00010000:00010000:0.0:1788460342.050680:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.050707:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788460342.050711:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5834:x1875336482535680:12345-0@lo:104: Request processed in 39us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.050716:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788460342.050734:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788460342.050739:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.050746:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4a00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460342.050750:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.050758:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460342.050764:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460342.050770:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460342.050799:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.050963:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460342.051150:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460342.051169:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051177:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460342.051212:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051220:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460342.051227:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460342.051242:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788460342.051258:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051265:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460342.051283:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051296:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f4400/0x889bb893541b6ff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051310:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051312:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051314:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051403:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051408:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051414:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460342.051416:0:7658:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051422:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460342.051427:0:7658:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460342.051432:0:7658:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788460342.051446:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051451:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460342.051457:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051463:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f5a00/0x889bb893541b6fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fe1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.051481:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051482:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051484:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051501:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.051503:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460342.051936:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460342.051961:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.051967:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b7027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b702e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.051977:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460342.051978:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460342.051980:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460342.052003:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536320:0@lo:103: 00000100:00100000:0.0:1788460342.052056:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.052094:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460342.052100:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536448:0@lo:103: 00000100:00100000:0.0:1788460342.052119:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.052428:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0260000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535424:0@lo:104: 00000100:00100000:2.0:1788460342.052439:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535552:0@lo:104: 00000100:00100000:2.0:1788460342.052446:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535680:0@lo:104: 00000100:00100000:1.0:1788460342.052611:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482536192:0@lo:103: 00000100:00100000:1.0:1788460342.052640:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.052714:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536320 00000100:00100000:0.0:1788460342.052720:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536320 00010000:00010000:0.0:1788460342.052747:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 19 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.052764:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536448 00000100:00100000:0.0:1788460342.052767:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536448 00010000:00010000:0.0:1788460342.052778:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fda expref: 20 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.052788:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536192 00000100:00100000:0.0:1788460342.052790:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536192 00010000:00010000:0.0:1788460342.052800:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7027 expref: 21 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.052904:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460342.052912:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:3316:x1875336482536320:12345-0@lo:103: 00010000:00010000:0.0:1788460342.052924:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460342.052929:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 21 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.052938:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 21 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.052954:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4800/0x889bb893541b6ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6ff6 expref: 21 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.052968:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460342.053011:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3316:x1875336482536320:12345-0@lo:103: Request processed in 99us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.053017:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460342.053042:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460342.053048:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:3316:x1875336482536448:12345-0@lo:103: 00010000:00010000:0.0:1788460342.053057:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460342.053061:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fda expref: 19 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.053070:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6fda expref: 19 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.053080:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c29f4a00/0x889bb893541b6fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6fda expref: 19 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.053099:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460342.053122:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3316:x1875336482536448:12345-0@lo:103: Request processed in 74us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.053128:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460342.053139:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460342.053144:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:3318:x1875336482536192:12345-0@lo:103: 00010000:00010000:0.0:1788460342.053163:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460342.053168:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7027 expref: 17 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.053418:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7027 expref: 17 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.053431:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c0030800/0x889bb893541b702e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7027 expref: 17 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.053441:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460342.053473:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:3318:x1875336482536192:12345-0@lo:103: Request processed in 329us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.053480:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460342.053650:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482536192:0@lo:103: 00000100:00100000:1.0:1788460342.053780:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536448:0@lo:103: 00000100:00100000:1.0:1788460342.053790:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536320:0@lo:103: 00000100:00100000:3.0:1788460342.053954:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.053968:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.053979:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535808 00000100:00100000:3.0:1788460342.053984:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535808 00000100:00100000:3.0:1788460342.054008:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482535936 00000100:00100000:3.0:1788460342.054011:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482535936 00000100:00100000:3.0:1788460342.054020:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536064 00000100:00100000:3.0:1788460342.054022:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536064 00000100:00100000:0.0:1788460342.054106:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460342.054115:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5834:x1875336482535808:12345-0@lo:104: 00010000:00010000:0.0:1788460342.054127:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.054713:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788460342.054721:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5834:x1875336482535808:12345-0@lo:104: Request processed in 607us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.054729:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460342.054749:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460342.054757:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5834:x1875336482535936:12345-0@lo:104: 00010000:00010000:1.0:1788460342.054767:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.054903:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788460342.054909:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5834:x1875336482535936:12345-0@lo:104: Request processed in 154us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.054916:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460342.054930:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460342.054936:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5834:x1875336482536064:12345-0@lo:104: 00010000:00010000:1.0:1788460342.054944:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.055044:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535808:0@lo:104: 00000100:00100000:2.0:1788460342.055055:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482535936:0@lo:104: 00000100:00100000:2.0:1788460342.055062:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5834:1875336482536064:0@lo:104: 00010000:00010000:2.0:1788460342.055091:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055392:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788460342.055414:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055423:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460342.055426:0:7658:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055435:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460342.055442:0:7658:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460342.055448:0:7658:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460342.055479:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055485:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460342.055609:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055617:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f4000/0x889bb893541b6fa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fa9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.055635:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460342.055649:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482536576:0@lo:103: 00000100:00100000:0.0:1788460342.055684:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.055724:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536576 00000100:00100000:0.0:1788460342.055729:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536576 00010000:00010000:0.0:1788460342.055752:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 16 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.055786:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460342.055793:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:3318:x1875336482536576:12345-0@lo:103: 00010000:00010000:0.0:1788460342.055879:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460342.055885:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 16 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055895:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 16 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055910:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c29f5800/0x889bb893541b6fa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6fa2 expref: 16 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.055923:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460342.055953:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:3318:x1875336482536576:12345-0@lo:103: Request processed in 160us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.055959:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460342.055987:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482536576:0@lo:103: 00010000:00010000:0.0:1788460342.056001:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460342.056005:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056011:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030a00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460342.056015:0:7658:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056022:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460342.056106:0:7658:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460342.056111:0:7658:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460342.056127:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056133:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460342.056148:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056166:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b6f6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f71 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.056587:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536704:0@lo:103: 00000100:00100000:0.0:1788460342.056621:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460342.056656:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460342.056660:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056667:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460342.056670:0:7658:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056676:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460342.056683:0:7658:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460342.056699:0:7658:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460342.056730:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056736:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460342.056745:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.056752:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b6f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f55 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.056773:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460342.056780:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536832:0@lo:103: 00000100:00100000:2.0:1788460342.056901:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536704 00000100:00100000:2.0:1788460342.056907:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536704 00010000:00010000:2.0:1788460342.056928:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102166200/0x889bb893541b6f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f6a expref: 15 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.056965:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460342.056972:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:3316:x1875336482536704:12345-0@lo:103: 00010000:00010000:2.0:1788460342.056981:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460342.056986:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102166200/0x889bb893541b6f71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f6a expref: 15 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.056995:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102166200/0x889bb893541b6f71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6f6a expref: 15 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.057006:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102166200/0x889bb893541b6f71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6f6a expref: 15 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.057017:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460342.057058:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:3316:x1875336482536704:12345-0@lo:103: Request processed in 86us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.057065:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460342.057169:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.057436:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536704:0@lo:103: 00010000:00010000:0.0:1788460342.057528:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460342.057531:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460342.057533:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460342.057699:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788460342.057707:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5834:x1875336482536064:12345-0@lo:104: Request processed in 2770us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.057715:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788460342.057790:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460342.057833:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460342.057958:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536832 00000100:00100000:2.0:1788460342.057963:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536832 00010000:00010000:2.0:1788460342.057984:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166ec00/0x889bb893541b6f55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f4e expref: 14 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.058050:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788460342.058059:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:3316:x1875336482536832:12345-0@lo:103: 00010000:00010000:2.0:1788460342.058068:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460342.058073:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166ec00/0x889bb893541b6f55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f4e expref: 14 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058081:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166ec00/0x889bb893541b6f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6f4e expref: 14 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058102:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166ec00/0x889bb893541b6f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6f4e expref: 14 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058114:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058122:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058135:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058142:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058148:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058165:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058170:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460342.058174:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058229:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058435:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.058460:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460342.058583:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.058592:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.058598:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167600/0x889bb893541b704a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788460342.058612:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788460342.059399:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:3316:x1875336482536832:12345-0@lo:103: Request processed in 1338us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.059418:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460342.059522:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482536832:0@lo:103: 00000100:00100000:3.0:1788460342.167135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:7652:x1875336482535296:12345-0@lo:253: Request processed in 140721us (141339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.167149:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788460342.167401:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482535296:0@lo:253: 10000000:01000000:2.0:1788460342.167417:0:7652:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788460342.167420:0:7652:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460342.167422:0:7652:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788460342.167424:0:7652:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460342.167425:0:7652:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788460342.167426:0:7652:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460342.167428:0:7652:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460342.167429:0:7652:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460342.167430:0:7652:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788460342.167432:0:7652:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460342.167433:0:7652:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788460342.167453:0:7652:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9650efb15800 from lustre-OST0001 10000000:01000000:2.0:1788460342.167475:0:7652:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788460342.167478:0:7652:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788460342.167484:0:7652:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9650efb15800 10000000:01000000:2.0:1788460342.167499:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460342.167512:0:7652:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788460342.174709:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460342.188642:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460342.188662:0:7652:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650efb15800 from 1 10000000:01000000:1.0:1788460342.188665:0:7652:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788460342.188704:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.188715:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.188725:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460342.188748:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482536960:0@lo:101: 00000100:00100000:1.0:1788460342.188821:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460342.188918:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4ea2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.188998:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482536960 00000100:00100000:3.0:1788460342.189006:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482536960 00000100:00100000:3.0:1788460342.189162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788460342.189172:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+12:7652:x1875336482536960:12345-0@lo:101: 00010000:00010000:3.0:1788460342.189268:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460342.189288:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7051 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460342.189313:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7051 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460342.189323:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7051 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460342.189332:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5a00, rc 0) 00000100:00100000:3.0:1788460342.189426:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:7652:x1875336482536960:12345-0@lo:101: Request processed in 255us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.189433:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788460342.189687:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482536960:0@lo:101: 00010000:00010000:2.0:1788460342.189701:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.189710:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.189787:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537088:0@lo:501: 00000100:00100000:2.0:1788460342.189822:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.189884:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.189924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537088 00000100:00100000:3.0:1788460342.189928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537088 00000100:00100000:3.0:1788460342.189991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788460342.189999:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:7652:x1875336482537088:12345-0@lo:501: 00000100:00100000:3.0:1788460342.190231:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:7652:x1875336482537088:12345-0@lo:501: Request processed in 232us (407us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460342.190239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788460342.190303:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537088:0@lo:501: 10000000:01000000:2.0:1788460342.190316:0:7652:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788460342.190352:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537216:0@lo:501: 00000100:00100000:2.0:1788460342.190375:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.190661:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.190704:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537216 00000100:00100000:1.0:1788460342.190709:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537216 00000100:00100000:1.0:1788460342.190730:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460342.190737:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:7652:x1875336482537216:12345-0@lo:501: 00000100:00100000:1.0:1788460342.190910:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:7652:x1875336482537216:12345-0@lo:501: Request processed in 172us (532us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460342.190917:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788460342.191094:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537216:0@lo:501: 10000000:01000000:2.0:1788460342.191121:0:7652:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788460342.191226:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.191236:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460342.191247:0:7652:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9650efb15800 10000000:01000000:2.0:1788460342.191254:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788460342.191269:0:7652:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788460342.191350:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460342.191357:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460342.191365:0:7652:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788460342.191368:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460342.191391:0:7652:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788460342.191426:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460342.191431:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460342.191436:0:7652:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9650efb15800 10000000:01000000:2.0:1788460342.191439:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788460342.191452:0:7652:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788460342.191459:0:7652:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788460342.191480:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.191631:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.191642:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.191657:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537344:0@lo:101: 00000100:00100000:2.0:1788460342.191684:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.191712:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.191765:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537344 00000100:00100000:1.0:1788460342.191769:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537344 00000100:00100000:1.0:1788460342.191802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788460342.191809:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+13:7652:x1875336482537344:12345-0@lo:101: 00010000:00010000:1.0:1788460342.191817:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460342.191827:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b705f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.191844:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b705f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.191853:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b705f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.191861:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166fa00, rc 0) 00000100:00100000:1.0:1788460342.191896:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537344:12345-0@lo:101: Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.191903:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788460342.191971:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537344:0@lo:101: 00010000:00010000:2.0:1788460342.191982:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.191991:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.192045:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537472:0@lo:501: 00000100:00100000:2.0:1788460342.192068:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.192090:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.192139:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537472 00000100:00100000:1.0:1788460342.192149:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537472 00000100:00100000:1.0:1788460342.192209:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788460342.192216:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537472:12345-0@lo:501: 00000100:00100000:1.0:1788460342.192374:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537472:12345-0@lo:501: Request processed in 159us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.192382:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788460342.192943:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537472:0@lo:501: 00000100:00100000:2.0:1788460342.192987:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537600:0@lo:503: 00000100:00100000:2.0:1788460342.193040:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.193067:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.193272:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537600 00000100:00100000:3.0:1788460342.193277:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537600 00000100:00100000:3.0:1788460342.193303:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788460342.193309:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537600:12345-0@lo:503: 00000100:00100000:3.0:1788460342.193460:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537600:12345-0@lo:503: Request processed in 150us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.193466:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788460342.193573:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537600:0@lo:503: 00000040:00080000:3.0:1788460342.193822:0:7652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460342.194127:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537728:0@lo:502: 00000100:00100000:3.0:1788460342.194175:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.194291:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537728 00000100:00100000:3.0:1788460342.194296:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537728 00000100:00100000:3.0:1788460342.194316:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788460342.194323:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537728:12345-0@lo:502: 00000100:00100000:3.0:1788460342.194464:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537728:12345-0@lo:502: Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.194471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788460342.194659:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92a0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.194674:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537728:0@lo:502: 00000040:00080000:3.0:1788460342.194893:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788460342.194939:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788460342.194973:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788460342.195045:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788460342.195085:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788460342.195117:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788460342.195141:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537856:0@lo:502: 00000100:00100000:3.0:1788460342.195422:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.195499:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92a0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.195663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537856 00000100:00100000:1.0:1788460342.195670:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537856 00000100:00100000:1.0:1788460342.195742:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788460342.195750:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537856:12345-0@lo:502: 00000100:00100000:1.0:1788460342.195914:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537856:12345-0@lo:502: Request processed in 164us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.195921:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788460342.195998:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537856:0@lo:502: 00000040:00080000:2.0:1788460342.196111:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788460342.196122:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788460342.196582:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788460342.196590:0:7661:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788460342.196596:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460342.196598:0:7661:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788460342.196602:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788460342.196620:0:7661:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9650f5cf6620) 00000020:00000080:0.0:1788460342.196640:0:7661:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788460342.196647:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788460342.196711:0:7661:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650efb15800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788460342.196724:0:7661:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788460342.196730:0:7661:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x889bb893541b7074 00010000:00010000:0.0:1788460342.202615:0:7661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788460342.202900:0:7661:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788460342.208054:0:7661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788460342.208369:0:7661:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788460342.212977:0:7661:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788460342.213634:0:7661:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788460342.215049:0:7661:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788460342.215060:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460342.215066:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460342.215068:0:7661:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788460342.215072:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460342.215075:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460342.215077:0:7661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788460342.215080:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788460342.215082:0:7661:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788460342.215132:0:7661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460342.215135:0:7661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460342.215136:0:7661:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788460342.215139:0:7661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788460342.217612:0:7652:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788460342.217629:0:7652:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788460342.217652:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.217663:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460342.217671:0:7652:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650efb15800 from 1 10000000:01000000:0.0:1788460342.217674:0:7652:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788460342.217708:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.217715:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.217727:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.217748:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537984:0@lo:101: 00000100:00100000:0.0:1788460342.217804:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.217845:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.217899:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482537984 00000100:00100000:1.0:1788460342.217906:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482537984 00000100:00100000:1.0:1788460342.217955:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788460342.217964:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482537984:12345-0@lo:101: 00010000:00010000:1.0:1788460342.217983:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460342.217996:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b707b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.218017:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b707b expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.218026:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b707b expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.218034:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166f800, rc 0) 00000100:00100000:1.0:1788460342.218069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:7652:x1875336482537984:12345-0@lo:101: Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.218076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788460342.218354:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482537984:0@lo:101: 00010000:00010000:0.0:1788460342.218368:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.218376:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.218978:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538112:0@lo:256: 00000100:00100000:0.0:1788460342.219017:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.219051:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.219101:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482538112 00000100:00100000:1.0:1788460342.219107:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482538112 00000100:00100000:1.0:1788460342.219141:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788460342.219149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:7652:x1875336482538112:12345-0@lo:256: 20000000:01000000:1.0:1788460342.219172:0:5837:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788460342.219350:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788460342.219355:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788460342.219357:0:5837:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:1.0:1788460342.219437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:7652:x1875336482538112:12345-0@lo:256: Request processed in 288us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.219444:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788460342.219575:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538112:0@lo:256: 10000000:01000000:0.0:1788460342.220126:0:7652:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460342.220328:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.220340:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460342.220346:0:7652:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650efb15800 from 1 10000000:01000000:0.0:1788460342.220349:0:7652:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788460342.220374:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.220382:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.220391:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.220418:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538240:0@lo:101: 00000100:00100000:0.0:1788460342.220455:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.220484:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.220590:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482538240 00000100:00100000:1.0:1788460342.220596:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482538240 00000100:00100000:1.0:1788460342.220629:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788460342.220637:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:7652:x1875336482538240:12345-0@lo:101: 00010000:00010000:1.0:1788460342.220653:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460342.220664:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.220686:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7089 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.220696:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7089 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.220705:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166e600, rc 0) 00000100:00100000:1.0:1788460342.220732:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538240:12345-0@lo:101: Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.220739:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788460342.220796:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538240:0@lo:101: 00010000:00010000:0.0:1788460342.220808:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.220816:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.220892:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538368:0@lo:501: 00000100:00100000:0.0:1788460342.220928:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.224263:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.226278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482538368 00000100:00100000:1.0:1788460342.226291:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482538368 00000100:00100000:1.0:1788460342.226341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788460342.226349:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538368:12345-0@lo:501: 00000100:00100000:1.0:1788460342.226614:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538368:12345-0@lo:501: Request processed in 265us (5684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.226621:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788460342.228325:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538368:0@lo:501: 00000100:00100000:0.0:1788460342.228381:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538496:0@lo:503: 00000100:00100000:0.0:1788460342.228441:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.228471:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.229165:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482538496 00000100:00100000:1.0:1788460342.229173:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482538496 00000100:00100000:1.0:1788460342.229239:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788460342.229247:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538496:12345-0@lo:503: 00000100:00100000:1.0:1788460342.229857:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538496:12345-0@lo:503: Request processed in 609us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.229866:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788460342.229974:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538496:0@lo:503: 00000040:00080000:0.0:1788460342.230425:0:7652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460342.230610:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538624:0@lo:502: 00000100:00100000:0.0:1788460342.230653:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.230719:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460342.230799:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482538624 00000100:00100000:2.0:1788460342.230805:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482538624 00000100:00100000:2.0:1788460342.230844:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788460342.230852:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538624:12345-0@lo:502: 00000100:00100000:2.0:1788460342.231025:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538624:12345-0@lo:502: Request processed in 173us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.231032:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788460342.231122:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538624:0@lo:502: 00000040:00080000:0.0:1788460342.231401:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788460342.231460:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788460342.231483:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538752:0@lo:502: 00000100:00100000:0.0:1788460342.231658:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.231686:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460342.231789:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482538752 00000100:00100000:2.0:1788460342.231794:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482538752 00000100:00100000:2.0:1788460342.231814:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788460342.231821:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538752:12345-0@lo:502: 00000100:00100000:2.0:1788460342.231956:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538752:12345-0@lo:502: Request processed in 134us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.231962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788460342.235392:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538752:0@lo:502: 00000040:00080000:0.0:1788460342.235600:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788460342.235616:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788460342.236534:0:7665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460342.236544:0:7665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460342.236546:0:7665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788460342.236553:0:7665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650efb15800 00000020:00000080:0.0:1788460342.236555:0:7665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460342.236574:0:7665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460342.236577:0:7665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460342.236579:0:7665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788460342.236581:0:7665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788460342.236738:0:7652:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788460342.236748:0:7652:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460342.236769:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.236780:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460342.236823:0:7652:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788460342.236826:0:7652:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9650efb15800 10000000:01000000:1.0:1788460342.236829:0:7652:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9650efb15800 10000000:01000000:1.0:1788460342.236834:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788460342.236846:0:7652:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788460342.236889:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460342.236895:0:7652:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460342.236907:0:7652:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650efb15800 from 1 10000000:01000000:1.0:1788460342.236911:0:7652:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788460342.236943:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.236953:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.236963:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460342.236982:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538880:0@lo:101: 00000100:00100000:1.0:1788460342.237041:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.237066:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482538880 00000100:00100000:3.0:1788460342.237072:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482538880 00000100:00100000:1.0:1788460342.237073:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.237113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788460342.237122:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:7652:x1875336482538880:12345-0@lo:101: 00010000:00010000:3.0:1788460342.237134:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460342.237146:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7097 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460342.237264:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7097 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460342.237275:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7097 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460342.237285:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4600, rc 0) 00000100:00100000:3.0:1788460342.237329:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482538880:12345-0@lo:101: Request processed in 209us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.237337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788460342.237371:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482538880:0@lo:101: 00010000:00010000:1.0:1788460342.237392:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460342.237405:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460342.237458:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539008:0@lo:501: 00000100:00100000:1.0:1788460342.237548:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460342.237578:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.237640:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539008 00000100:00100000:3.0:1788460342.237644:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539008 00000100:00100000:3.0:1788460342.237694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788460342.237701:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539008:12345-0@lo:501: 00000100:00100000:3.0:1788460342.237902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539008:12345-0@lo:501: Request processed in 200us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.237909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788460342.237962:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539008:0@lo:501: 00000100:00100000:0.0:1788460342.237989:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539136:0@lo:503: 00000100:00100000:0.0:1788460342.238026:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460342.239979:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539136 00000100:00100000:3.0:1788460342.239991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539136 00000100:00100000:3.0:1788460342.240040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788460342.240050:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539136:12345-0@lo:503: 00000100:00100000:0.0:1788460342.240060:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.240337:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539136:12345-0@lo:503: Request processed in 289us (2310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.240346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788460342.240382:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539136:0@lo:503: 00000040:00080000:0.0:1788460342.241277:0:7652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460342.241345:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539264:0@lo:502: 00000100:00100000:0.0:1788460342.241393:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.241455:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460342.241483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539264 00000100:00100000:1.0:1788460342.241488:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539264 00000100:00100000:1.0:1788460342.241522:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788460342.241530:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539264:12345-0@lo:502: 00000100:00100000:1.0:1788460342.241741:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539264:12345-0@lo:502: Request processed in 211us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.241748:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788460342.241904:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539264:0@lo:502: 00000040:00080000:0.0:1788460342.242611:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788460342.242669:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788460342.242894:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788460342.242968:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788460342.243004:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788460342.243106:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788460342.243146:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788460342.243211:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788460342.243258:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788460342.243303:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788460342.243697:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788460342.244254:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788460342.244289:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788460342.244325:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788460342.244384:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788460342.244420:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788460342.244452:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788460342.244492:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788460342.244521:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788460342.244551:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788460342.244590:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788460342.244619:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788460342.244648:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788460342.244688:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788460342.244718:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788460342.244749:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788460342.244790:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788460342.244898:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788460342.244931:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788460342.244974:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788460342.245006:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788460342.245034:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788460342.245129:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788460342.245230:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788460342.245275:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788460342.245330:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788460342.245368:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788460342.245411:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539392:0@lo:502: 00000100:00100000:0.0:1788460342.245475:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.245522:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460342.245543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539392 00000100:00100000:2.0:1788460342.245551:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539392 00000100:00100000:2.0:1788460342.245599:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788460342.245608:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539392:12345-0@lo:502: 00000100:00100000:2.0:1788460342.245818:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482539392:12345-0@lo:502: Request processed in 211us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.245827:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788460342.246994:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482539392:0@lo:502: 00000040:00080000:0.0:1788460342.247283:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788460342.247296:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788460342.248119:0:7666:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788460342.248134:0:7666:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9650f5eb1988) 00000020:00000080:2.0:1788460342.248168:0:7666:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788460342.248357:0:7666:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650efb15800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788460342.248367:0:7666:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650efb15800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788460342.248371:0:7666:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650efb15800 3 00010000:00080000:2.0:1788460342.248399:0:7666:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650fd26e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1788460342.253061:0:7666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788460342.253687:0:7666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788460342.253725:0:7666:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788460342.253737:0:7666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x889bb893541b70ac 00000100:00080000:2.0:1788460342.253748:0:7666:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460342.253754:0:7666:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9650fd26e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460342.253787:0:7666:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d0261180 x1875336482539520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460342.253813:0:7666:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788460342.255125:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482539520:0@lo:38: 00000100:00100000:1.0:1788460342.255282:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.255346:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539520 00000100:00100000:2.0:1788460342.255353:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539520 00000100:00100000:2.0:1788460342.255391:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460342.255398:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482539520:12345-0@lo:38: 00010000:00080000:2.0:1788460342.255430:0:5842:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1788460342.255460:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x889bb893541b70b3 00000004:00100000:2.0:1788460342.255474:0:5842:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788460342.255502:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9650fd268000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460342.255558:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875336482539520:12345-0@lo:38: Request processed in 158us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.255565:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788460342.255594:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0261180 x1875336482539520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460342.255605:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788460342.255612:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788460342.255619:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788460342.255623:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788460342.255625:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650fd26e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788460342.255631:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482539520:0@lo:38: 00000100:00100000:2.0:1788460342.255918:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460342.255964:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482539776:0@lo:400: 00000100:00100000:2.0:1788460342.256006:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.256027:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482539648:0@lo:400: 00000100:00100000:2.0:1788460342.256056:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460342.256701:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539776 00000100:00100000:1.0:1788460342.256708:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539776 00000100:00100000:0.0:1788460342.256971:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482539904:0@lo:400: 00000100:00100000:3.0:1788460342.257631:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539648 00000100:00100000:3.0:1788460342.257637:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539648 00000100:00100000:3.0:1788460342.257676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460342.257691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482539648:12345-0@lo:400: 00000100:00100000:1.0:1788460342.258377:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460342.258385:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482539776:12345-0@lo:400: 00000100:00080000:2.0:1788460342.260688:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460342.267581:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482539648:12345-0@lo:400: Request processed in 9883us (11514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.267596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788460342.267672:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3fb80 x1875336482539648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460342.267687:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482539648:0@lo:400: 00000100:00100000:0.0:1788460342.267907:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460342.267957:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482539904 00000100:00100000:0.0:1788460342.267964:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482539904 00000100:00100000:0.0:1788460342.268026:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460342.268035:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482539904:12345-0@lo:400: 00000100:00100000:0.0:1788460342.268091:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482539904:12345-0@lo:400: Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.268099:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788460342.268127:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3f800 x1875336482539904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460342.268138:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482539904:0@lo:400: 00000040:00080000:2.0:1788460342.269289:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1788460342.269447:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1788460342.270054:0:7652:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788460342.270068:0:7652:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788460342.270091:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.270104:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788460342.270172:0:7652:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788460342.270607:0:7652:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788460342.270608:0:7652:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460342.270610:0:7652:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460342.270611:0:7652:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460342.270612:0:7652:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460342.270614:0:7652:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460342.270615:0:7652:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788460342.270616:0:7652:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788460342.270618:0:7652:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460342.270619:0:7652:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460342.270623:0:7652:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788460342.270626:0:7652:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788460342.270627:0:7652:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788460342.270628:0:7652:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460342.270629:0:7652:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460342.270630:0:7652:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460342.270631:0:7652:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460342.270632:0:7652:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460342.270633:0:7652:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788460342.270634:0:7652:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788460342.270635:0:7652:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460342.270636:0:7652:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460342.270660:0:7652:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788460342.270677:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482540032:0@lo:253: 00000100:00100000:0.0:1788460342.270738:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460342.270757:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482539776:12345-0@lo:400: Request processed in 12369us (14756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460342.270771:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460342.270779:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76780 going to sleep for 11 seconds 00010000:00080000:3.0:1788460342.270916:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d0a3d500 x1875336482539776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460342.270931:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482539776:0@lo:400: 00000100:00100000:1.0:1788460342.271311:0:7667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831e300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7667:1875336482540160:0@lo:901: 00000100:00100000:1.0:1788460342.271344:0:7667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460342.271365:0:7667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460342.271611:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540160 00000100:00100000:3.0:1788460342.271618:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540160 00000100:00100000:3.0:1788460342.271674:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788460342.271679:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460342.271685:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7667:x1875336482540160:12345-0@lo:901: 00000100:00100000:3.0:1788460342.272165:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7667:x1875336482540160:12345-0@lo:901: Request processed in 483us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460342.272173:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788460342.272257:0:7667:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d831e300 x1875336482540160/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788460358 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460342.272264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540032 00000100:00100000:1.0:1788460342.272269:0:7667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831e300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7667:1875336482540160:0@lo:901: 00000100:00100000:0.0:1788460342.272886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540032 00000100:00100000:0.0:1788460342.272960:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788460342.272969:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:7652:x1875336482540032:12345-0@lo:253: 20000000:01000000:0.0:1788460342.273006:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788460342.273019:0:5837:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788460342.360019:0:5837:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788460342.360050:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788460342.360168:0:5858:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788460342.360173:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788460342.360225:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360243:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fcc expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360251:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360259:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b707b expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360266:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360304:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b707b expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360318:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b707b expref: 17 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.360331:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482540288:0@lo:104: 00000100:00100000:2.0:1788460342.360391:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460342.360445:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360471:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 17 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.360480:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0260380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482540416:0@lo:104: 00000100:00100000:2.0:1788460342.360504:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460342.360528:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6fcc expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360537:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6fcc expref: 17 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.360546:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482540544:0@lo:104: 00000100:00100000:2.0:1788460342.360562:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460342.360585:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788460342.360676:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.360687:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540288 00000100:00100000:2.0:1788460342.360693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540288 00000100:00100000:2.0:1788460342.360727:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540416 00000100:00100000:2.0:1788460342.360729:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540416 00000100:00100000:2.0:1788460342.360737:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540544 00000100:00100000:2.0:1788460342.360739:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540544 00000100:00100000:2.0:1788460342.360751:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788460342.360759:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5858:x1875336482540288:12345-0@lo:104: 00010000:00010000:2.0:1788460342.360771:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.360826:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460342.360832:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:5858:x1875336482540288:12345-0@lo:104: Request processed in 74us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.360845:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788460342.360864:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460342.360870:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5ca7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5858:x1875336482540416:12345-0@lo:104: 00010000:00010000:2.0:1788460342.360878:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361025:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460342.361090:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5ca7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:5858:x1875336482540416:12345-0@lo:104: Request processed in 220us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.361096:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460342.361130:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460342.361137:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5858:x1875336482540544:12345-0@lo:104: 00010000:00010000:2.0:1788460342.361144:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361210:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788460342.361215:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:5858:x1875336482540544:12345-0@lo:104: Request processed in 80us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.361222:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788460342.361237:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460342.361243:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361251:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460342.361255:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361274:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460342.361282:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460342.361288:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460342.361314:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361321:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460342.361336:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361343:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b707b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7082 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361357:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460342.361361:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361367:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460342.361370:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361377:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460342.361383:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460342.361394:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460342.361407:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361413:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460342.361426:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361433:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f5400/0x889bb893541b6fe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361443:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460342.361446:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361451:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460342.361455:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361461:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460342.361467:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460342.361473:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460342.361483:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361490:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460342.361500:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361507:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b6fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6fd3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.361519:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460342.361522:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460342.361523:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460342.361542:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482540672:0@lo:103: 00000100:00100000:2.0:1788460342.361572:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460342.361797:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460342.361809:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460342.366737:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482540800:0@lo:103: 00000100:00100000:2.0:1788460342.366818:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.366860:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460342.366866:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482540928:0@lo:103: 00000100:00100000:2.0:1788460342.366888:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460342.366923:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540672 00000100:00100000:2.0:1788460342.366930:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540672 00010000:00010000:2.0:1788460342.366964:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b707b expref: 18 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.366970:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540800 00000100:00100000:0.0:1788460342.366977:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540800 00000100:00100000:2.0:1788460342.366992:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482540928 00000100:00100000:2.0:1788460342.366997:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482540928 00010000:00010000:0.0:1788460342.367000:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 19 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.367014:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fcc expref: 20 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460342.367080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460342.367091:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ea552450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3317:x1875336482540672:12345-0@lo:103: 00010000:00010000:0.0:1788460342.367103:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460342.367108:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b707b expref: 20 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367120:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b707b expref: 20 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367138:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460342.367213:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788460342.367222:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788460342.367257:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ea552450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3317:x1875336482540672:12345-0@lo:103: Request processed in 167us (5683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.367265:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460342.367311:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460342.367319:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:3318:x1875336482540800:12345-0@lo:103: 00010000:00010000:0.0:1788460342.367326:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460342.367334:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166f800/0x889bb893541b7082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b707b expref: 19 pid: 5836 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367334:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 19 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367353:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 19 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367363:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460342.367380:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482540288:0@lo:104: 00000100:00100000:0.0:1788460342.367393:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3318:x1875336482540800:12345-0@lo:103: Request processed in 75us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.367408:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460342.367420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460342.367425:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:3318:x1875336482540928:12345-0@lo:103: 00010000:00010000:0.0:1788460342.367432:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460342.367436:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6fcc expref: 17 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367445:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6fcc expref: 17 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367455:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367464:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788460342.367475:0:5828:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007302895s 00010000:00010000:0.0:1788460342.367479:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367487:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367493:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367500:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367506:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460342.367514:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367522:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367530:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460342.367539:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460342.367557:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:3318:x1875336482540928:12345-0@lo:103: Request processed in 132us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460342.367563:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460342.367672:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482540928:0@lo:103: 00000100:00100000:0.0:1788460342.367685:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0260a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482540800:0@lo:103: 00010000:00010000:2.0:1788460342.367748:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c29f4c00/0x889bb893541b6fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6fe8 expref: 16 pid: 5837 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.367763:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0260380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482540416:0@lo:104: 00010000:00010000:2.0:1788460342.368078:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c29f5000/0x889bb893541b6fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6fcc expref: 15 pid: 5834 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460342.368090:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875336482540544:0@lo:104: 00010000:00010000:2.0:1788460342.368108:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.368117:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.368123:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460342.368129:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167800/0x889bb893541b70ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460342.368247:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482540672:0@lo:103: 00000100:00100000:2.0:1788460342.389454:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:7652:x1875336482540032:12345-0@lo:253: Request processed in 116478us (118708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460342.389469:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788460342.389578:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7652:1875336482540032:0@lo:253: 10000000:01000000:0.0:1788460342.389667:0:7652:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788460342.389671:0:7652:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788460342.389672:0:7652:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788460342.389673:0:7652:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460342.389675:0:7652:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460342.389676:0:7652:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460342.389677:0:7652:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460342.389678:0:7652:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460342.389679:0:7652:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788460342.389680:0:7652:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788460342.389682:0:7652:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460342.389683:0:7652:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788460342.389695:0:7652:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788460342.394965:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460342.395536:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788460342.395895:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460342.396314:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788460342.397123:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460342.397470:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788460342.402167:0:7652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788460342.639505:0:7652:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788460342.639512:0:7652:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788460342.639545:0:7652:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788460342.639573:0:7652:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788460342.670685:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460343.692530:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460343.826981:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460343.827007:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482541056:0@lo:13: 00000100:00100000:1.0:1788460343.827078:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460343.827164:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541056 00000100:00100000:1.0:1788460343.827171:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541056 00000100:00100000:1.0:1788460343.827245:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460343.827254:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482541056:12345-0@lo:13: 00002000:00000024:1.0:1788460343.827284:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460343.827327:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482541056:12345-0@lo:13: Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460343.827334:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788460343.827375:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831e300 x1875336482541056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460343.827393:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482541056:0@lo:13: 00010000:00010000:0.0:1788460344.717409:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460345.740375:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460346.764349:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460347.406810:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482541568:0@lo:400: 00000100:00100000:3.0:1788460347.406873:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460347.407156:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482541184:0@lo:400: 00000100:00100000:1.0:1788460347.407201:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460347.407637:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482541312:0@lo:400: 00000100:00100000:3.0:1788460347.407669:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460347.407740:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460347.407747:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482541440:0@lo:400: 00000100:00100000:3.0:1788460347.407776:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460347.407808:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541568 00000100:00100000:3.0:1788460347.407815:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541568 00000100:00100000:3.0:1788460347.407860:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460347.407868:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482541568:12345-0@lo:400: 00000100:00100000:3.0:1788460347.407910:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482541568:12345-0@lo:400: Request processed in 43us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460347.407925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460347.407946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541312 00000100:00100000:3.0:1788460347.407950:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541312 00000100:00100000:3.0:1788460347.407971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541440 00000100:00100000:3.0:1788460347.407973:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541440 00000100:00100000:3.0:1788460347.408001:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788460347.408008:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482541312:12345-0@lo:400: 00000100:00100000:2.0:1788460347.408099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541184 00000100:00100000:2.0:1788460347.408109:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541184 00000100:00100000:2.0:1788460347.408148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788460347.408154:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:3317:x1875336482541184:12345-0@lo:400: 00000100:00100000:2.0:1788460347.408216:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:3317:x1875336482541184:12345-0@lo:400: Request processed in 62us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460347.408222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788460347.410195:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460347.410204:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460347.410225:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460347.410239:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482541440:12345-0@lo:400: 00000100:00100000:3.0:1788460347.410248:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482541312:12345-0@lo:400: Request processed in 2240us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460347.410257:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460347.410285:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482541440:12345-0@lo:400: Request processed in 52us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460347.410291:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788460347.410313:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8ce00 x1875336482541440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460347.410327:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482541440:0@lo:400: 00010000:00080000:3.0:1788460347.410339:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8d180 x1875336482541312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460347.410347:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482541312:0@lo:400: 00010000:00080000:0.0:1788460347.410421:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8e300 x1875336482541568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460347.410431:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482541568:0@lo:400: 00000100:00100000:1.0:1788460347.411526:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482541184:0@lo:400: 00000100:00100000:1.0:1788460347.411536:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482541696:0@lo:400: 00000100:00100000:1.0:1788460347.411579:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460347.412262:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541696 00000100:00100000:3.0:1788460347.412270:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541696 00000100:00100000:3.0:1788460347.412329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788460347.412337:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482541696:12345-0@lo:400: 00000100:00100000:3.0:1788460347.412412:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482541696:12345-0@lo:400: Request processed in 76us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460347.412420:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788460347.412455:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8ea00 x1875336482541696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460347.412466:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482541696:0@lo:400: 00000100:00080000:0.0:1788460347.413200:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460347.790780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788460348.436064:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460348.436071:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650efb15800 from 5 10000000:01000000:3.0:1788460348.436076:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460348.436130:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.436143:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.436155:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460348.436203:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482541824:0@lo:101: 00000100:00100000:3.0:1788460348.436268:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.436317:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c8e4d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.436473:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541824 00000100:00100000:2.0:1788460348.436482:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541824 00000100:00100000:2.0:1788460348.436532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788460348.436541:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482541824:12345-0@lo:101: 00010000:00010000:2.0:1788460348.436553:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460348.436566:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167600/0x889bb893541b70c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b70c1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.436586:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167600/0x889bb893541b70c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b70c1 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.436595:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167600/0x889bb893541b70c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70c1 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.436603:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167600, rc 0) 00000100:00100000:2.0:1788460348.436651:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482541824:12345-0@lo:101: Request processed in 110us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.436657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788460348.436740:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482541824:0@lo:101: 00010000:00010000:0.0:1788460348.436754:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460348.436773:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460348.436828:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482541952:0@lo:256: 00000100:00100000:0.0:1788460348.436860:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460348.436889:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.437046:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482541952 00000100:00100000:2.0:1788460348.437051:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482541952 00000100:00100000:2.0:1788460348.437082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788460348.437089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482541952:12345-0@lo:256: 20000000:01000000:2.0:1788460348.437103:0:5834:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788460348.437138:0:5834:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788460348.437141:0:5834:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788460348.437241:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482541952:12345-0@lo:256: Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.437249:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788460348.437347:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482541952:0@lo:256: 10000000:01000000:0.0:1788460348.437385:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460348.437392:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460348.437399:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460348.437410:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788460348.437412:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650f6139800 from 30 10000000:01000000:0.0:1788460348.437415:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788460348.437431:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460348.437438:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460348.437445:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460348.437456:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542080:0@lo:101: 00000100:00100000:0.0:1788460348.437481:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460348.437492:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.437592:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542080 00000100:00100000:2.0:1788460348.437596:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542080 00000100:00100000:2.0:1788460348.437625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788460348.437631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482542080:12345-0@lo:101: 00010000:00010000:2.0:1788460348.437639:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460348.437647:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b70cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.437662:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b70cf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.437671:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70cf expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.437677:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167c00, rc 0) 00000100:00100000:2.0:1788460348.437702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542080:12345-0@lo:101: Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.437707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788460348.439772:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542080:0@lo:101: 00010000:00010000:0.0:1788460348.439796:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460348.439808:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460348.441729:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788460348.445812:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460348.446642:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788460348.446692:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:0.0:1788460348.446724:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:0.0:1788460348.446894:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:0.0:1788460348.446997:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:0.0:1788460348.447046:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:0.0:1788460348.447083:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:0.0:1788460348.448497:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:0.0:1788460348.448587:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:0.0:1788460348.448621:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:0.0:1788460348.448652:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:0.0:1788460348.448691:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:0.0:1788460348.448722:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:0.0:1788460348.448749:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:0.0:1788460348.448805:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:0.0:1788460348.448834:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:0.0:1788460348.448859:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:0.0:1788460348.448894:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:0.0:1788460348.449092:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:0.0:1788460348.449138:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:0.0:1788460348.449213:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:0.0:1788460348.449249:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:0.0:1788460348.449277:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:0.0:1788460348.449320:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:0.0:1788460348.449513:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 128 off12440 00000040:00080000:0.0:1788460348.449548:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12664 00000040:00080000:0.0:1788460348.449596:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12888 00000040:00080000:0.0:1788460348.449631:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off12968 00000040:00080000:0.0:1788460348.449715:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13192 00000040:00080000:0.0:1788460348.449736:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788460348.450023:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542208:0@lo:501: 00000100:00100000:0.0:1788460348.450085:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460348.451161:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.460517:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542208 00000100:00100000:2.0:1788460348.460531:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542208 00000100:00100000:2.0:1788460348.460585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788460348.460595:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542208:12345-0@lo:501: 00000100:00100000:2.0:1788460348.460983:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542208:12345-0@lo:501: Request processed in 388us (10896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.461002:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788460348.461066:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542208:0@lo:501: 00000100:00100000:2.0:1788460348.461140:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542336:0@lo:503: 00000100:00100000:2.0:1788460348.461383:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.461415:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92a0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.461429:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542336 00000100:00100000:2.0:1788460348.461433:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542336 00000100:00100000:2.0:1788460348.461457:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788460348.461463:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542336:12345-0@lo:503: 00000100:00100000:2.0:1788460348.461732:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542336:12345-0@lo:503: Request processed in 267us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.461739:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788460348.461786:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542336:0@lo:503: 00000040:00080000:2.0:1788460348.462485:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460348.462557:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542464:0@lo:502: 00000100:00100000:2.0:1788460348.462599:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.462627:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c93af9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.462669:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542464 00000100:00100000:2.0:1788460348.462673:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542464 00000100:00100000:2.0:1788460348.462699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788460348.462707:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542464:12345-0@lo:502: 00000100:00100000:2.0:1788460348.462922:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542464:12345-0@lo:502: Request processed in 214us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.462929:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788460348.462977:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542464:0@lo:502: 00000040:00080000:2.0:1788460348.463316:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788460348.463362:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:2.0:1788460348.463397:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:2.0:1788460348.463449:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:2.0:1788460348.463489:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:2.0:1788460348.463564:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:2.0:1788460348.463607:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:2.0:1788460348.463643:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:2.0:1788460348.463694:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:2.0:1788460348.463734:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:2.0:1788460348.463772:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:2.0:1788460348.463823:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:2.0:1788460348.463861:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:2.0:1788460348.463904:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:2.0:1788460348.463959:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:2.0:1788460348.464000:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:2.0:1788460348.464036:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:2.0:1788460348.464124:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:2.0:1788460348.465008:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:2.0:1788460348.465062:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:2.0:1788460348.465140:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:2.0:1788460348.465220:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:2.0:1788460348.465266:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:2.0:1788460348.465318:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:2.0:1788460348.465356:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 128 off12440 00000040:00080000:2.0:1788460348.465390:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12664 00000040:00080000:2.0:1788460348.465455:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12888 00000040:00080000:2.0:1788460348.465736:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off12968 00000040:00080000:2.0:1788460348.465884:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13192 00000040:00080000:2.0:1788460348.465949:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13416 00000040:00080000:2.0:1788460348.465988:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13504 00000040:00080000:2.0:1788460348.466025:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13632 00000040:00080000:2.0:1788460348.466095:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13776 00000040:00080000:2.0:1788460348.466309:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13904 00000040:00080000:2.0:1788460348.466358:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14128 00000040:00080000:2.0:1788460348.466413:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14352 00000040:00080000:2.0:1788460348.466456:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14432 00000100:00100000:2.0:1788460348.466505:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542592:0@lo:502: 00000100:00100000:2.0:1788460348.466580:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.466681:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92a0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.466724:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542592 00000100:00100000:3.0:1788460348.466730:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542592 00000100:00100000:3.0:1788460348.466827:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788460348.466837:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542592:12345-0@lo:502: 00000100:00100000:3.0:1788460348.467061:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542592:12345-0@lo:502: Request processed in 225us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.467069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788460348.467359:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542592:0@lo:502: 00000040:00080000:2.0:1788460348.467431:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14656 00000040:00080000:2.0:1788460348.467441:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000040:00080000:2.0:1788460348.468338:0:7947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 39 count 39 00000020:01000000:3.0:1788460348.468475:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788460348.468485:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788460348.468495:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.468506:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460348.468516:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460348.468518:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650f6139800 from 5 10000000:01000000:3.0:1788460348.468521:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460348.468549:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.468558:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.468566:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460348.468583:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542720:0@lo:101: 00000100:00100000:3.0:1788460348.468622:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.468939:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542720 00000100:00100000:3.0:1788460348.468942:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c8e4d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.468946:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542720 00000100:00100000:2.0:1788460348.470504:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788460348.470519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482542720:12345-0@lo:101: 00010000:00010000:2.0:1788460348.470536:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460348.470551:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167200/0x889bb893541b70e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b70dd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.470578:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167200/0x889bb893541b70e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b70dd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.470589:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167200/0x889bb893541b70e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70dd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.470596:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167200, rc 0) 00000100:00100000:2.0:1788460348.470664:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482542720:12345-0@lo:101: Request processed in 150us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.470680:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788460348.470737:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542720:0@lo:101: 00010000:00010000:2.0:1788460348.470800:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.470812:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460348.470872:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542848:0@lo:256: 00000100:00100000:2.0:1788460348.470908:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.470944:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea52a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.470996:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542848 00000100:00100000:3.0:1788460348.471002:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542848 00000100:00100000:3.0:1788460348.471153:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788460348.471161:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482542848:12345-0@lo:256: 20000000:01000000:3.0:1788460348.471175:0:5834:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460348.471207:0:5834:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460348.471211:0:5834:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788460348.471289:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482542848:12345-0@lo:256: Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.471294:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788460348.471351:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542848:0@lo:256: 10000000:01000000:2.0:1788460348.471376:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460348.471381:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.471387:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460348.471396:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788460348.471397:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788460348.471399:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788460348.471418:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.471423:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.471436:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460348.471445:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542976:0@lo:101: 00000100:00100000:2.0:1788460348.471462:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.471476:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d11a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.471484:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482542976 00000100:00100000:2.0:1788460348.471651:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482542976 00000100:00100000:2.0:1788460348.471678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788460348.471685:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482542976:12345-0@lo:101: 00010000:00010000:2.0:1788460348.471692:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460348.471701:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b70eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.471717:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b70eb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.471725:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70eb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.471732:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167800, rc 0) 00000100:00100000:2.0:1788460348.471761:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482542976:12345-0@lo:101: Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.471767:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788460348.471795:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482542976:0@lo:101: 00010000:00010000:2.0:1788460348.471806:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.471825:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460348.472707:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788460348.473013:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460348.473400:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788460348.473431:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:2.0:1788460348.473449:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:2.0:1788460348.473474:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:2.0:1788460348.473610:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:2.0:1788460348.473635:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:2.0:1788460348.473674:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:2.0:1788460348.473678:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788460348.473728:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543104:0@lo:501: 00000100:00100000:2.0:1788460348.473773:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.473981:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d11a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.474027:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482543104 00000100:00100000:3.0:1788460348.474033:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482543104 00000100:00100000:3.0:1788460348.474107:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788460348.474125:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543104:12345-0@lo:501: 00000100:00100000:3.0:1788460348.474404:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543104:12345-0@lo:501: Request processed in 281us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.474410:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788460348.474603:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543104:0@lo:501: 00000100:00100000:2.0:1788460348.474626:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543232:0@lo:503: 00000100:00100000:2.0:1788460348.474652:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.474751:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d11a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.474781:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482543232 00000100:00100000:3.0:1788460348.474785:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482543232 00000100:00100000:3.0:1788460348.474906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788460348.474914:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543232:12345-0@lo:503: 00000100:00100000:3.0:1788460348.475280:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543232:12345-0@lo:503: Request processed in 366us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.475285:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788460348.475389:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543232:0@lo:503: 00000040:00080000:2.0:1788460348.475888:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460348.475944:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543360:0@lo:502: 00000100:00100000:2.0:1788460348.475982:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.476013:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d11a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.476028:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482543360 00000100:00100000:2.0:1788460348.476038:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482543360 00000100:00100000:2.0:1788460348.476070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788460348.476077:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543360:12345-0@lo:502: 00000100:00100000:2.0:1788460348.476545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543360:12345-0@lo:502: Request processed in 467us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.476554:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788460348.476604:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543360:0@lo:502: 00000040:00080000:2.0:1788460348.477043:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788460348.477250:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:2.0:1788460348.477298:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788460348.477345:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788460348.477378:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788460348.477409:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788460348.477454:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:2.0:1788460348.477618:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788460348.477668:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000100:00100000:2.0:1788460348.477701:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543488:0@lo:502: 00000100:00100000:2.0:1788460348.477750:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.477780:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d11a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.477858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482543488 00000100:00100000:3.0:1788460348.477865:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482543488 00000100:00100000:3.0:1788460348.477975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788460348.477987:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543488:12345-0@lo:502: 00000100:00100000:3.0:1788460348.478174:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543488:12345-0@lo:502: Request processed in 188us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.478214:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788460348.478244:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543488:0@lo:502: 00000040:00080000:2.0:1788460348.478341:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 00000040:00080000:2.0:1788460348.478351:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000020:01000000:1.0:1788460348.483566:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460348.483579:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460348.483582:0:7948:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788460348.483588:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788460348.483590:0:7948:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788460348.483607:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460348.483610:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460348.483611:0:7948:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788460348.483614:0:7948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788460348.483894:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788460348.483920:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788460348.483932:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.483952:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460348.483963:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788460348.483966:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650f6139800 from 1 10000000:01000000:3.0:1788460348.483970:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788460348.484003:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.484011:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.484022:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460348.484043:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543616:0@lo:101: 00000100:00100000:3.0:1788460348.484107:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.484158:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.484860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482543616 00000100:00100000:1.0:1788460348.484868:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482543616 00000100:00100000:1.0:1788460348.484917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788460348.484925:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482543616:12345-0@lo:101: 00010000:00010000:1.0:1788460348.484945:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460348.484957:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b70f9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.484978:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b70f9 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.484988:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70f9 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.484997:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166ea00, rc 0) 00000100:00100000:1.0:1788460348.485037:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482543616:12345-0@lo:101: Request processed in 113us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460348.485044:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788460348.485520:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543616:0@lo:101: 00010000:00010000:3.0:1788460348.485537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.485546:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460348.485625:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543744:0@lo:501: 00000100:00100000:3.0:1788460348.485654:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.485694:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.485856:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482543744 00000100:00100000:2.0:1788460348.485860:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482543744 00000100:00100000:2.0:1788460348.485892:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788460348.485899:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482543744:12345-0@lo:501: 00000100:00100000:2.0:1788460348.486087:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482543744:12345-0@lo:501: Request processed in 188us (432us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460348.486102:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788460348.488484:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543744:0@lo:501: 10000000:01000000:3.0:1788460348.488512:0:5839:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788460348.488594:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543872:0@lo:501: 00000100:00100000:3.0:1788460348.488643:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.488679:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.488818:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482543872 00000100:00100000:1.0:1788460348.488825:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482543872 00000100:00100000:1.0:1788460348.488867:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788460348.488875:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482543872:12345-0@lo:501: 00000100:00100000:1.0:1788460348.489086:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482543872:12345-0@lo:501: Request processed in 211us (441us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460348.489092:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788460348.489464:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482543872:0@lo:501: 10000000:01000000:3.0:1788460348.489501:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788460348.489511:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.489523:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460348.489533:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788460348.489536:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650c5118800 from 30 10000000:01000000:3.0:1788460348.489539:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788460348.489561:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.489570:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.489578:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460348.489593:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544000:0@lo:101: 00000100:00100000:3.0:1788460348.489623:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.489657:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.489856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544000 00000100:00100000:1.0:1788460348.489862:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544000 00000100:00100000:1.0:1788460348.489897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788460348.489913:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482544000:12345-0@lo:101: 00010000:00010000:1.0:1788460348.489922:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460348.489935:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7107 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.489966:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7107 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.489977:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7107 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.489986:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166f000, rc 0) 00000100:00100000:1.0:1788460348.490024:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482544000:12345-0@lo:101: Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460348.490030:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788460348.490260:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544000:0@lo:101: 00010000:00010000:3.0:1788460348.490275:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.490284:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460348.490315:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544128:0@lo:501: 00000100:00100000:3.0:1788460348.490350:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.490370:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.490471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544128 00000100:00100000:2.0:1788460348.490476:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544128 00000100:00100000:2.0:1788460348.490505:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788460348.490512:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482544128:12345-0@lo:501: 00000100:00100000:2.0:1788460348.490704:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482544128:12345-0@lo:501: Request processed in 192us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.490711:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788460348.490879:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544128:0@lo:501: 00000100:00100000:3.0:1788460348.490971:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544256:0@lo:503: 00000100:00100000:3.0:1788460348.491010:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.491031:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.492168:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544256 00000100:00100000:2.0:1788460348.492190:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544256 00000100:00100000:2.0:1788460348.492224:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788460348.492232:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482544256:12345-0@lo:503: 00000100:00100000:2.0:1788460348.492593:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482544256:12345-0@lo:503: Request processed in 360us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.492601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788460348.492658:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544256:0@lo:503: 00000100:00100000:3.0:1788460348.524644:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7949:1875336482544384:0@lo:502: 00000100:00100000:3.0:1788460348.524726:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.524775:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.525002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544384 00000100:00100000:2.0:1788460348.525010:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544384 00000100:00100000:2.0:1788460348.525057:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788460348.525066:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:7949:x1875336482544384:12345-0@lo:502: 00000100:00100000:2.0:1788460348.525335:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:7949:x1875336482544384:12345-0@lo:502: Request processed in 269us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.525343:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788460348.527917:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7949:1875336482544384:0@lo:502: 00000100:00100000:3.0:1788460348.527997:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7949:1875336482544512:0@lo:502: 00000100:00100000:3.0:1788460348.528057:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.528100:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.529101:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544512 00000100:00100000:1.0:1788460348.529121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544512 00000100:00100000:1.0:1788460348.529176:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788460348.529197:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:7949:x1875336482544512:12345-0@lo:502: 00000100:00100000:1.0:1788460348.529433:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:7949:x1875336482544512:12345-0@lo:502: Request processed in 237us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.530737:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7949:1875336482544512:0@lo:502: 00000040:00080000:3.0:1788460348.530848:0:7949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788460348.531089:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788460348.531098:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788460348.531118:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.531141:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460348.531152:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460348.531154:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5118800 from 5 10000000:01000000:2.0:1788460348.531157:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460348.531222:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.531230:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.531238:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460348.531257:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544640:0@lo:101: 00000100:00100000:2.0:1788460348.531306:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.531337:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea52a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.531404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544640 00000100:00100000:3.0:1788460348.531410:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544640 00000100:00100000:1.0:1788460348.531856:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788460348.531986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788460348.531996:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482544640:12345-0@lo:101: 00010000:00010000:3.0:1788460348.532010:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460348.532023:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5c00/0x889bb893541b711c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7115 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.532044:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5c00/0x889bb893541b711c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7115 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.532055:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5c00/0x889bb893541b711c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7115 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.532063:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5c00, rc 0) 00000100:00100000:3.0:1788460348.532103:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482544640:12345-0@lo:101: Request processed in 109us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.532118:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788460348.532219:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544640:0@lo:101: 00010000:00010000:2.0:1788460348.532233:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.532242:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460348.532288:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544768:0@lo:256: 00000100:00100000:2.0:1788460348.532357:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.532391:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea52a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.532544:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544768 00000100:00100000:1.0:1788460348.532549:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544768 00000100:00100000:1.0:1788460348.532579:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788460348.532586:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482544768:12345-0@lo:256: 20000000:01000000:1.0:1788460348.532599:0:5836:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788460348.532615:0:5836:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788460348.532618:0:5836:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788460348.532687:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482544768:12345-0@lo:256: Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460348.532693:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788460348.534988:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544768:0@lo:256: 10000000:01000000:2.0:1788460348.535058:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460348.535068:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.535079:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460348.535089:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788460348.535091:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788460348.535094:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788460348.535134:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.535142:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.535151:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460348.535169:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544896:0@lo:101: 00000100:00100000:2.0:1788460348.535245:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.535282:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.535958:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482544896 00000100:00100000:1.0:1788460348.535966:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482544896 00000100:00100000:1.0:1788460348.536012:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788460348.536021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482544896:12345-0@lo:101: 00010000:00010000:1.0:1788460348.536034:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460348.536047:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7123 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.536070:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7123 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.536080:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7123 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460348.536088:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166ee00, rc 0) 00000100:00100000:1.0:1788460348.536136:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482544896:12345-0@lo:101: Request processed in 115us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460348.536142:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788460348.537900:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482544896:0@lo:101: 00010000:00010000:2.0:1788460348.537936:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.537948:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460348.538012:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482545024:0@lo:501: 00000100:00100000:2.0:1788460348.538055:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.538100:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.538171:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545024 00000100:00100000:3.0:1788460348.538212:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545024 00000100:00100000:3.0:1788460348.538248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788460348.538256:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482545024:12345-0@lo:501: 00000100:00100000:3.0:1788460348.538497:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482545024:12345-0@lo:501: Request processed in 241us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.538505:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788460348.542577:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482545024:0@lo:501: 00000100:00100000:2.0:1788460348.542638:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482545152:0@lo:503: 00000100:00100000:2.0:1788460348.542708:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.542753:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.542863:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545152 00000100:00100000:3.0:1788460348.542870:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545152 00000100:00100000:3.0:1788460348.542930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788460348.542940:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482545152:12345-0@lo:503: 00000100:00100000:3.0:1788460348.543299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482545152:12345-0@lo:503: Request processed in 360us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.543314:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788460348.543607:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482545152:0@lo:503: 00000100:00100000:2.0:1788460348.543830:0:7950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7950:1875336482545280:0@lo:502: 00000100:00100000:2.0:1788460348.543869:0:7950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.543911:0:7950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c066c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.544065:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545280 00000100:00100000:1.0:1788460348.544070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545280 00000100:00100000:1.0:1788460348.544106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788460348.544122:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:7950:x1875336482545280:12345-0@lo:502: 00000100:00100000:1.0:1788460348.544388:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:7950:x1875336482545280:12345-0@lo:502: Request processed in 266us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460348.544395:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788460348.544651:0:7950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7950:1875336482545280:0@lo:502: 00000020:01000000:2.0:1788460348.544676:0:7950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788460348.544683:0:7950:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788460348.544691:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460348.544693:0:7950:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788460348.544697:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788460348.544701:0:7950:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:2.0:1788460348.544720:0:7950:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788460348.544723:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460348.544737:0:7950:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9650f5eb0000) 00000020:00000080:2.0:1788460348.544755:0:7950:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788460348.544772:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788460348.544845:0:7950:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788460348.544850:0:7950:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788460348.544865:0:7950:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b7138 00010000:00080000:2.0:1788460348.544893:0:7950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650c7cfe000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1788460348.545127:0:7950:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788460348.546331:0:7950:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788460348.546346:0:7950:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788460348.548756:0:7950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460348.549172:0:7950:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460348.549257:0:7950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788460348.549312:0:7950:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788460348.549977:0:7951:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788460348.549982:0:7951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788460348.552455:0:7950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788460348.552472:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788460348.552508:0:7950:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788460348.552529:0:7950:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b713f 00000100:00080000:2.0:1788460348.552540:0:7950:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460348.552545:0:7950:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650c7cfe000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460348.552581:0:7950:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d0262a00 x1875336482545408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460348.552607:0:7950:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788460348.552699:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482545536:0@lo:400: 00000100:00100000:2.0:1788460348.552759:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.552806:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460348.552812:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482545664:0@lo:400: 00000100:00100000:2.0:1788460348.552834:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.552862:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482545920:0@lo:400: 00000100:00100000:3.0:1788460348.553076:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482545408:0@lo:8: 00000100:00100000:3.0:1788460348.553120:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.553173:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545408 00000100:00100000:3.0:1788460348.553201:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545408 00000100:00100000:3.0:1788460348.553230:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460348.553237:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3315:x1875336482545408:12345-0@lo:8: 00010000:00080000:3.0:1788460348.553261:0:6701:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:3.0:1788460348.553285:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b7146 00002000:00100000:3.0:1788460348.553298:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9650efd49800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788460348.553302:0:6701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788460348.553306:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788460348.553421:0:6701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788460348.553579:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788460348.553612:0:6701:0:(import.c:65:import_set_state_nolock()) ffff964fc3da0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460348.553661:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875336482545408:12345-0@lo:8: Request processed in 422us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.553667:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788460348.553714:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0262a00 x1875336482545408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460348.553724:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460348.553730:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788460348.553736:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788460348.553741:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788460348.553743:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650c7cfe000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788460348.553752:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788460348.553763:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482545408:0@lo:8: 00000100:00100000:2.0:1788460348.554053:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.554084:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460348.554091:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482545792:0@lo:400: 00000100:00100000:2.0:1788460348.554135:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.554166:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545536 00000100:00100000:2.0:1788460348.554170:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545536 00000100:00100000:2.0:1788460348.554216:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545664 00000100:00100000:2.0:1788460348.554218:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545664 00000100:00100000:2.0:1788460348.554228:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545920 00000100:00100000:2.0:1788460348.554230:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545920 00000100:00100000:2.0:1788460348.554240:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460348.554246:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482545536:12345-0@lo:400: 00000100:00100000:2.0:1788460348.554284:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482545536:12345-0@lo:400: Request processed in 38us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.554290:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460348.554304:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460348.554310:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482545664:12345-0@lo:400: 00000100:00100000:2.0:1788460348.554334:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482545664:12345-0@lo:400: Request processed in 25us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.554340:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460348.554350:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788460348.554355:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482545920:12345-0@lo:400: 00000100:00100000:2.0:1788460348.554381:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482545920:12345-0@lo:400: Request processed in 26us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.554387:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788460348.554406:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482545792 00000100:00100000:2.0:1788460348.554409:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482545792 00000100:00100000:2.0:1788460348.554430:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460348.554436:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482545792:12345-0@lo:400: 00000100:00100000:2.0:1788460348.554476:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482545792:12345-0@lo:400: Request processed in 40us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.554489:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788460348.554523:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0263800 x1875336482545664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460348.554533:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482545664:0@lo:400: 00010000:00080000:2.0:1788460348.554543:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0260380 x1875336482545536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460348.554550:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482545536:0@lo:400: 00010000:00080000:2.0:1788460348.554580:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0263100 x1875336482545792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460348.554588:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482545792:0@lo:400: 00010000:00080000:2.0:1788460348.554596:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0261500 x1875336482545920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460348.554602:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482545920:0@lo:400: 00000004:00080000:2.0:1788460348.554620:0:7951:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788460348.554712:0:7951:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 221790532890ns, next at 0ns, rc = 0 00000020:01000000:2.0:1788460348.554776:0:7950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460348.554782:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460348.554784:0:7950:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788460348.554787:0:7950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460348.554791:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460348.554792:0:7950:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788460348.554795:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788460348.554797:0:7950:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788460348.554823:0:7950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7950:1875336482546048:0@lo:502: 00000100:00100000:2.0:1788460348.554863:0:7950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.554894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546048 00000100:00100000:2.0:1788460348.554898:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546048 00000100:00100000:2.0:1788460348.555600:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788460348.555609:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:7950:x1875336482546048:12345-0@lo:502: 00000100:00100000:2.0:1788460348.556029:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:7950:x1875336482546048:12345-0@lo:502: Request processed in 420us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.556037:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788460348.556080:0:7950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea52a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.556099:0:7950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:7950:1875336482546048:0@lo:502: 00000020:01000000:2.0:1788460348.556140:0:7950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460348.556146:0:7950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460348.556148:0:7950:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788460348.556152:0:7950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788460348.557857:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788460348.557869:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788460348.557880:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.557890:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460348.557900:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788460348.557914:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650c5118800 from 1 10000000:01000000:3.0:1788460348.557917:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788460348.557951:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.557960:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.557971:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460348.557990:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482546176:0@lo:101: 00000100:00100000:3.0:1788460348.558044:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.558072:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.558553:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546176 00000100:00100000:2.0:1788460348.558560:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546176 00000100:00100000:2.0:1788460348.561486:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788460348.561503:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482546176:12345-0@lo:101: 00010000:00010000:2.0:1788460348.561521:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460348.561538:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b714d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.561564:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b714d expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.561576:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b714d expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.561584:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167e00, rc 0) 00000100:00100000:2.0:1788460348.561655:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482546176:12345-0@lo:101: Request processed in 157us (3610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.561669:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788460348.573945:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482546176:0@lo:101: 00010000:00010000:2.0:1788460348.573978:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460348.573992:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460348.574051:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482546304:0@lo:501: 00000100:00100000:2.0:1788460348.574123:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.574169:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d08099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460348.574212:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546304 00000100:00100000:2.0:1788460348.574217:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546304 00000100:00100000:2.0:1788460348.574265:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788460348.574275:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482546304:12345-0@lo:501: 00000100:00100000:2.0:1788460348.574513:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482546304:12345-0@lo:501: Request processed in 239us (390us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460348.574521:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788460348.575212:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482546304:0@lo:501: 10000000:01000000:3.0:1788460348.575232:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788460348.575241:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460348.575252:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788460348.656545:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788460348.656717:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482546432:0@lo:13: 00000100:00100000:0.0:1788460348.656779:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460348.658287:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546432 00000100:00100000:2.0:1788460348.658299:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546432 00000100:00100000:2.0:1788460348.658361:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460348.658371:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482546432:12345-0@lo:13: 00002000:00000024:2.0:1788460348.658404:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:3.0:1788460348.660333:0:7952:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788460348.660370:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482546560:0@lo:7: 00000100:00100000:3.0:1788460348.660414:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.660447:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546560 00000100:00100000:3.0:1788460348.660452:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546560 00000100:00100000:3.0:1788460348.660486:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460348.660493:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7952:x1875336482546560:12345-0@lo:7: 00000100:00100000:2.0:1788460348.666229:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482546432:12345-0@lo:13: Request processed in 7523us (9113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.666246:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788460348.666315:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788460348.666666:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788460348.666672:0:6699:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788460348.666736:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7952:x1875336482546560:12345-0@lo:7: Request processed in 6241us (6320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460348.666745:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460348.666779:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db9c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788460348.666803:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8ce00 x1875336482546560/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788460364 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460348.666817:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482546560:0@lo:7: 00000004:00080000:3.0:1788460348.666831:0:7952:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788460348.666865:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482546688:0@lo:5: 00000100:00100000:3.0:1788460348.666892:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460348.666965:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db9c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788460348.667208:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8c380 x1875336482546432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460348.667226:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482546432:0@lo:13: 00000100:00100000:1.0:1788460348.667376:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546688 00000100:00100000:1.0:1788460348.667383:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546688 00000100:00100000:1.0:1788460348.667464:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460348.667474:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7952:x1875336482546688:12345-0@lo:5: 00002000:00080000:1.0:1788460348.667504:0:6701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788460348.667507:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788460348.667752:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7952:x1875336482546688:12345-0@lo:5: Request processed in 279us (858us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788460348.667758:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788460348.667817:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8ce00 x1875336482546688/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460364 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460348.667829:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482546688:0@lo:5: 00000004:00080000:0.0:1788460348.667837:0:7952:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788460348.667863:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482546816:0@lo:700: 00000100:00100000:0.0:1788460348.667932:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460348.667958:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100600 going to sleep for 11 seconds 00000100:00100000:1.0:1788460348.668084:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546816 00000100:00100000:1.0:1788460348.668088:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546816 00000100:00100000:1.0:1788460348.668307:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460348.668317:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7952:x1875336482546816:12345-0@lo:700: 00000100:00100000:1.0:1788460348.668347:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1875336482546944:0@lo:700: 00000100:00100000:1.0:1788460348.668375:0:6708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460348.668400:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.668453:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482546944 00000100:00100000:3.0:1788460348.668457:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482546944 00000100:00100000:3.0:1788460348.668489:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788460348.668496:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1875336482546944:12345-0@lo:700: 40000000:02000000:0.0:1788460348.699418:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788460348.706911:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1875336482546944:12345-0@lo:700: Request processed in 38408us (38528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460348.706924:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788460348.708311:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831ca80 x1875336482546944/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788460364 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460348.708327:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1875336482546944:0@lo:700: 40000000:02000000:0.0:1788460348.708340:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1788460348.815514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788460348.816504:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788460348.816523:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788460348.816615:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7952:x1875336482546816:12345-0@lo:700: Request processed in 148295us (148678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460348.816627:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788460348.816670:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0a3f100 x1875336482546816/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788460364 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460348.816682:0:7952:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788460348.816698:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482546816:0@lo:700: 00000004:02000040:1.0:1788460348.867337:0:7952:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788460348.875100:0:7952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482547072:0@lo:5: 00000100:00100000:1.0:1788460348.875324:0:7952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460348.875369:0:7952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460348.875655:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547072 00000100:00100000:3.0:1788460348.875672:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547072 00000100:00100000:3.0:1788460348.875725:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460348.875883:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7952:x1875336482547072:12345-0@lo:5: 00002000:00080000:3.0:1788460348.889913:0:6699:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788460348.889932:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788460348.895449:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7952:x1875336482547072:12345-0@lo:5: Request processed in 19708us (20117us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788460348.895461:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788460348.895610:0:7952:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831d500 x1875336482547072/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460364 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460348.895627:0:7952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7952:1875336482547072:0@lo:5: 00000004:00080000:2.0:1788460348.895640:0:7952:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788460348.940480:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482547200:0@lo:13: 00000100:00100000:3.0:1788460348.940638:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460348.940758:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547200 00000100:00100000:1.0:1788460348.940766:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547200 00000100:00100000:1.0:1788460348.940805:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460348.940814:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482547200:12345-0@lo:13: 00002000:00000024:1.0:1788460348.940851:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460348.940903:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482547200:12345-0@lo:13: Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460348.940909:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788460348.941280:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831fb80 x1875336482547200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460348.941299:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482547200:0@lo:13: 00000001:02000400:1.0:1788460349.726227:0:8019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788460349.848907:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460350.866728:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460351.889955:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460352.908487:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460353.935522:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460354.060376:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460354.060402:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482547328:0@lo:13: 00000100:00100000:3.0:1788460354.060478:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460354.060543:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547328 00000100:00100000:3.0:1788460354.060550:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547328 00000100:00100000:3.0:1788460354.060598:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460354.060607:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482547328:12345-0@lo:13: 00002000:00000024:3.0:1788460354.060642:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460354.060685:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482547328:12345-0@lo:13: Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460354.060693:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788460354.060714:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788460354.060743:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8e300 x1875336482547328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460354.060777:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482547328:0@lo:13: 00000100:00100000:2.0:1788460354.064545:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482547456:0@lo:13: 00000100:00100000:2.0:1788460354.064609:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460354.064673:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547456 00000100:00100000:2.0:1788460354.064680:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547456 00000100:00100000:2.0:1788460354.064725:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460354.064747:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482547456:12345-0@lo:13: 00002000:00000024:2.0:1788460354.064784:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460354.064828:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482547456:12345-0@lo:13: Request processed in 95us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460354.064836:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788460354.064875:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0263100 x1875336482547456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460354.064893:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0263100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482547456:0@lo:13: 00000100:00080000:2.0:1788460354.064922:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460354.066840:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482547712:0@lo:400: 00000100:00100000:1.0:1788460354.066916:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460354.066955:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460354.066961:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482547584:0@lo:400: 00000100:00100000:1.0:1788460354.066992:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460354.067028:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482547840:0@lo:400: 00000100:00100000:1.0:1788460354.067052:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460354.067082:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460354.067088:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482547968:0@lo:400: 00000100:00100000:1.0:1788460354.067110:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460354.067136:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547712 00000100:00100000:1.0:1788460354.067142:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547712 00000100:00100000:1.0:1788460354.067212:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547840 00000100:00100000:1.0:1788460354.067216:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547840 00000100:00100000:1.0:1788460354.067238:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547968 00000100:00100000:1.0:1788460354.067242:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547968 00000100:00100000:1.0:1788460354.067257:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460354.067264:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482547712:12345-0@lo:400: 00000100:00100000:1.0:1788460354.067314:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482547712:12345-0@lo:400: Request processed in 49us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460354.067321:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460354.067337:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460354.067351:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482547840:12345-0@lo:400: 00000100:00100000:1.0:1788460354.067383:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482547840:12345-0@lo:400: Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460354.067388:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460354.067400:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460354.067405:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482547968:12345-0@lo:400: 00000100:00100000:1.0:1788460354.067431:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482547968:12345-0@lo:400: Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460354.067437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788460354.067474:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831ca80 x1875336482547968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460354.067487:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482547968:0@lo:400: 00010000:00080000:1.0:1788460354.067497:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831fb80 x1875336482547840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460354.067504:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482547840:0@lo:400: 00010000:00080000:1.0:1788460354.067532:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831dc00 x1875336482547712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460354.067540:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482547712:0@lo:400: 00000100:00100000:3.0:1788460354.072140:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482547584 00000100:00100000:3.0:1788460354.072154:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482547584 00000100:00100000:3.0:1788460354.072235:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788460354.072246:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482547584:12345-0@lo:400: 00000100:00100000:3.0:1788460354.072335:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482547584:12345-0@lo:400: Request processed in 92us (5342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460354.072343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788460354.072406:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482547584:0@lo:400: 00000100:00080000:3.0:1788460354.072453:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788460354.145944:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788460354.956391:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460355.047316:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460355.047359:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462598272 00000100:00100000:3.0:1788460355.047369:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462598272 00000100:00100000:3.0:1788460355.047405:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:3.0:1788460355.047413:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2378:x1875336462598272:12345-192.168.203.32@tcp:250: 00010000:00080000:3.0:1788460355.047442:0:5834:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0@192.168.203.32@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1788460355.047470:0:5834:0:(genops.c:1385:class_connect()) connect: client f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0, cookie 0x889bb893541b715b 00000100:00080000:3.0:1788460355.047609:0:5834:0:(import.c:65:import_set_state_nolock()) ffff964fc3da0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460355.047678:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+5:2378:x1875336462598272:12345-192.168.203.32@tcp:250: Request processed in 257us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460355.047687:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:3.0:1788460355.055485:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460355.055745:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462598400 00000100:00100000:2.0:1788460355.055767:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462598400 00000100:00100000:2.0:1788460355.055823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:2.0:1788460355.055834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+5:5607:x1875336462598400:12345-192.168.203.32@tcp:101: 00010000:00010000:2.0:1788460355.055852:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460355.055870:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1152 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460355.055900:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460355.055912:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460355.055922:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008c00, rc 0) 00000100:00100000:2.0:1788460355.055979:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+6:5607:x1875336462598400:12345-192.168.203.32@tcp:101: Request processed in 147us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460355.055986:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:2.0:1788460355.069251:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460355.069334:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462598528 00000100:00100000:0.0:1788460355.069345:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462598528 00000100:00100000:0.0:1788460355.069462:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:0.0:1788460355.069472:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+6:5607:x1875336462598528:12345-192.168.203.32@tcp:501: 00000100:00100000:0.0:1788460355.070072:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+6:5607:x1875336462598528:12345-192.168.203.32@tcp:501: Request processed in 466us (787us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460355.070083:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:0.0:1788460355.082789:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460355.083053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462598656 00000100:00100000:3.0:1788460355.083062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462598656 00000100:00100000:3.0:1788460355.083108:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:3.0:1788460355.083121:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+6:5607:x1875336462598656:12345-192.168.203.32@tcp:101: 00010000:00010000:3.0:1788460355.083135:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460355.083148:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1159 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460355.083167:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460355.083175:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460355.083194:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4400, rc 0) 00000100:00100000:3.0:1788460355.083232:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+7:5607:x1875336462598656:12345-192.168.203.32@tcp:101: Request processed in 112us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460355.083237:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:1.0:1788460355.091255:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460355.091470:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462598784 00000100:00100000:0.0:1788460355.091481:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462598784 00000100:00100000:0.0:1788460355.091539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:0.0:1788460355.091549:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+7:5607:x1875336462598784:12345-192.168.203.32@tcp:501: 00000100:00100000:0.0:1788460355.091774:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5607:x1875336462598784:12345-192.168.203.32@tcp:501: Request processed in 226us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460355.091782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:0.0:1788460355.094232:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460355.095233:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462598912 00000100:00100000:1.0:1788460355.095245:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462598912 00000100:00100000:1.0:1788460355.095299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:1.0:1788460355.095310:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5607:x1875336462598912:12345-192.168.203.32@tcp:503: 00000100:00100000:1.0:1788460355.095752:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5607:x1875336462598912:12345-192.168.203.32@tcp:503: Request processed in 442us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460355.095760:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:2.0:1788460355.100748:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460355.100786:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599040 00000100:00100000:2.0:1788460355.100795:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599040 00000100:00100000:2.0:1788460355.100840:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 134 00000100:00100000:2.0:1788460355.100849:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5626:x1875336462599040:12345-192.168.203.32@tcp:502: 00000100:00100000:2.0:1788460355.101474:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5626:x1875336462599040:12345-192.168.203.32@tcp:502: Request processed in 623us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460355.101483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 134 00000100:00100000:0.0:1788460355.141595:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460355.142694:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599168 00000100:00100000:1.0:1788460355.142707:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599168 00000100:00100000:1.0:1788460355.142753:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00100000:1.0:1788460355.142762:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5626:x1875336462599168:12345-192.168.203.32@tcp:502: 00000100:00100000:1.0:1788460355.144978:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5626:x1875336462599168:12345-192.168.203.32@tcp:502: Request processed in 2207us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460355.144991:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00100000:1.0:1788460355.152204:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460355.152366:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599296 00000100:00100000:2.0:1788460355.152387:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599296 00000100:00100000:2.0:1788460355.152440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:2.0:1788460355.152449:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5607:x1875336462599296:12345-192.168.203.32@tcp:101: 00010000:00010000:2.0:1788460355.152467:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460355.152483:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008e00/0x889bb893541b7170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1183 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460355.152511:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008e00/0x889bb893541b7170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1183 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460355.152522:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008e00/0x889bb893541b7170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1183 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460355.152531:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008e00, rc 0) 00000100:00100000:2.0:1788460355.152585:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5607:x1875336462599296:12345-192.168.203.32@tcp:101: Request processed in 136us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460355.152591:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:1.0:1788460355.161681:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460355.162013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599424 00000100:00100000:3.0:1788460355.162023:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599424 00000100:00100000:3.0:1788460355.162414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:3.0:1788460355.162425:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5607:x1875336462599424:12345-192.168.203.32@tcp:256: 20000000:01000000:3.0:1788460355.162448:0:5837:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788460355.162469:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460355.162472:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788460355.162475:0:5837:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788460355.162478:0:5837:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788460355.166580:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5607:x1875336462599424:12345-192.168.203.32@tcp:256: Request processed in 4146us (4896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460355.166593:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:1.0:1788460355.181423:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460355.182216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599552 00000100:00100000:3.0:1788460355.182238:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599552 00000100:00100000:3.0:1788460355.182361:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:3.0:1788460355.182371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5607:x1875336462599552:12345-192.168.203.32@tcp:101: 00010000:00010000:3.0:1788460355.182387:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460355.182405:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d118a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460355.182430:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460355.182444:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460355.182453:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4c00, rc 0) 00000100:00100000:3.0:1788460355.182573:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5607:x1875336462599552:12345-192.168.203.32@tcp:101: Request processed in 203us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460355.182579:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:0.0:1788460355.185000:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460355.185091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599680 00000100:00100000:3.0:1788460355.185100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599680 00000100:00100000:3.0:1788460355.185155:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00100000:3.0:1788460355.185165:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5607:x1875336462599680:12345-192.168.203.32@tcp:501: 00000100:00100000:3.0:1788460355.185615:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5607:x1875336462599680:12345-192.168.203.32@tcp:501: Request processed in 450us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460355.185624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00100000:1.0:1788460355.188599:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460355.188689:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599808 00000100:00100000:0.0:1788460355.188699:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599808 00000100:00100000:0.0:1788460355.188782:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 140 00000100:00100000:0.0:1788460355.188792:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5607:x1875336462599808:12345-192.168.203.32@tcp:503: 00000100:00100000:0.0:1788460355.189464:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5607:x1875336462599808:12345-192.168.203.32@tcp:503: Request processed in 671us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460355.189484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 140 00000100:00100000:0.0:1788460355.192912:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460355.193290:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462599936 00000100:00100000:1.0:1788460355.193301:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462599936 00000100:00100000:1.0:1788460355.193400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:1.0:1788460355.193410:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5631:x1875336462599936:12345-192.168.203.32@tcp:502: 00000100:00100000:1.0:1788460355.193680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5631:x1875336462599936:12345-192.168.203.32@tcp:502: Request processed in 270us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460355.193688:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:3.0:1788460355.195462:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460355.195506:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600064 00000100:00100000:2.0:1788460355.195514:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600064 00000100:00100000:2.0:1788460355.195560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:2.0:1788460355.195569:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5631:x1875336462600064:12345-192.168.203.32@tcp:502: 00000100:00100000:2.0:1788460355.195762:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5631:x1875336462600064:12345-192.168.203.32@tcp:502: Request processed in 193us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460355.195770:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:0.0:1788460355.198919:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460355.199347:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600192 00000100:00100000:1.0:1788460355.199358:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600192 00000100:00100000:1.0:1788460355.199473:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460355.199482:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2378:x1875336462600192:12345-192.168.203.32@tcp:38: 00010000:00080000:1.0:1788460355.199570:0:5842:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from 9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1788460355.199629:0:5842:0:(genops.c:1385:class_connect()) connect: client 9e69358b-6b5d-4a87-b6fb-534c610a3920, cookie 0x889bb893541b717e 00000004:00100000:1.0:1788460355.199656:0:5842:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788460355.199661:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788460355.225174:0:5842:0:(import.c:65:import_set_state_nolock()) ffff964fc12d0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460355.225286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2378:x1875336462600192:12345-192.168.203.32@tcp:38: Request processed in 25802us (26375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460355.225297:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00010000:00010000:0.0:1788460355.981130:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460356.235290:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460356.235338:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460356.235446:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600320 00000100:00100000:0.0:1788460356.235456:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600320 00000100:00100000:0.0:1788460356.235532:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600448 00000100:00100000:0.0:1788460356.235536:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600448 00000100:00100000:0.0:1788460356.235556:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1788460356.235565:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:0:x1875336462600320:12345-192.168.203.32@tcp:41: 00000004:00000024:0.0:1788460356.235608:0:7007:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788460356.235669:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:0:x1875336462600320:12345-192.168.203.32@tcp:41: Request processed in 105us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460356.235677:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00080000:3.0:1788460356.235941:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460356.235982:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1788460356.235991:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5607:x1875336462600448:12345-192.168.203.32@tcp:41: 00000004:00000024:3.0:1788460356.236006:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788460356.236048:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5607:x1875336462600448:12345-192.168.203.32@tcp:41: Request processed in 58us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460356.236064:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1788460356.238175:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460356.238347:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600576 00000100:00100000:2.0:1788460356.238356:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600576 00000100:00100000:2.0:1788460356.238422:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460356.238432:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5607:x1875336462600576:12345-192.168.203.32@tcp:40: 00000100:00100000:2.0:1788460356.238518:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5607:x1875336462600576:12345-192.168.203.32@tcp:40: Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460356.238530:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460356.242586:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460356.242623:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460356.242753:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460356.242796:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460356.244017:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600704 00000100:00100000:0.0:1788460356.244028:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600704 00000100:00100000:0.0:1788460356.244089:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600832 00000100:00100000:0.0:1788460356.244093:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600832 00000100:00100000:0.0:1788460356.244108:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1788460356.244116:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2378:x1875336462600704:12345-192.168.203.32@tcp:8: 00010000:00080000:0.0:1788460356.244146:0:6699:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from 9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1788460356.244173:0:6699:0:(genops.c:1385:class_connect()) connect: client 9e69358b-6b5d-4a87-b6fb-534c610a3920, cookie 0x889bb893541b7185 00002000:00100000:0.0:1788460356.244199:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9e69358b-6b5d-4a87-b6fb-534c610a3920/ffff9650f5cfe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788460356.244221:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788460356.244629:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462600960 00000100:00100000:1.0:1788460356.244635:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462600960 00000100:00100000:1.0:1788460356.244682:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1788460356.244707:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5607:x1875336462600960:12345-192.168.203.32@tcp:33: 00000100:00100000:1.0:1788460356.244786:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601088 00000100:00100000:1.0:1788460356.244790:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601088 00000100:00100000:1.0:1788460356.244823:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 143 00000100:00100000:1.0:1788460356.244832:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2380:x1875336462601088:12345-192.168.203.32@tcp:400: 00000100:00100000:1.0:1788460356.244902:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2380:x1875336462601088:12345-192.168.203.32@tcp:400: Request processed in 72us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460356.244911:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 143 00002000:00080000:0.0:1788460356.245019:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788460356.245248:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460356.245289:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2378:x1875336462600704:12345-192.168.203.32@tcp:8: Request processed in 1172us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460356.245298:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1788460356.245435:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1788460356.245440:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2378:x1875336462600832:12345-192.168.203.32@tcp:8: 00010000:00080000:0.0:1788460356.245458:0:6699:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from 9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1788460356.245486:0:6699:0:(genops.c:1385:class_connect()) connect: client 9e69358b-6b5d-4a87-b6fb-534c610a3920, cookie 0x889bb893541b718c 00002000:00100000:0.0:1788460356.245495:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e69358b-6b5d-4a87-b6fb-534c610a3920/ffff9650f5cfd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788460356.245510:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788460356.245771:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788460356.245789:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9650f5cf8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460356.245837:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2378:x1875336462600832:12345-192.168.203.32@tcp:8: Request processed in 394us (3212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460356.245845:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000004:00080000:3.0:1788460356.271784:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27017us 00000004:00200000:3.0:1788460356.303331:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788460356.303433:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5607:x1875336462600960:12345-192.168.203.32@tcp:33: Request processed in 58739us (60676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460356.303446:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1788460356.478815:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460356.478972:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601216 00000100:00100000:2.0:1788460356.478981:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601216 00000100:00100000:2.0:1788460356.479047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460356.479069:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5648:x1875336462601216:12345-192.168.203.32@tcp:101: 00010000:00010000:2.0:1788460356.479090:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460356.479161:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d11b4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460356.479280:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b719a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460356.479299:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b719a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460356.479316:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b719a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460356.479349:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460356.479353:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460356.479370:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b719a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460356.479414:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11b4 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460356.479432:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b719a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11b4 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460356.479440:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460356.479443:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460356.479447:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009000, rc 0) 00000100:00100000:2.0:1788460356.479669:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:5648:x1875336462601216:12345-192.168.203.32@tcp:101: Request processed in 611us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460356.479677:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:0.0:1788460357.006736:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460358.028498:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460358.318738:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460358.318838:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601344 00000100:00100000:3.0:1788460358.318848:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601344 00000100:00100000:3.0:1788460358.318926:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1788460358.318944:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:5700:x1875336462601344:12345-192.168.203.32@tcp:41: 00000100:00080000:2.0:1788460358.319114:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788460358.319140:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788460358.319225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:5700:x1875336462601344:12345-192.168.203.32@tcp:41: Request processed in 290us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460358.319233:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1788460358.321958:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460358.322274:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601472 00000100:00100000:2.0:1788460358.322286:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601472 00000100:00080000:3.0:1788460358.322359:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460358.322364:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460358.322376:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5700:x1875336462601472:12345-192.168.203.32@tcp:13: 00002000:00000024:2.0:1788460358.322411:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460358.322488:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5700:x1875336462601472:12345-192.168.203.32@tcp:13: Request processed in 114us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460358.322495:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1788460358.325204:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460358.326986:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601600 00000100:00100000:2.0:1788460358.327001:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601600 00000100:00100000:2.0:1788460358.327092:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1788460358.327103:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5700:x1875336462601600:12345-192.168.203.32@tcp:13: 00002000:00000024:2.0:1788460358.327161:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460358.327263:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:5700:x1875336462601600:12345-192.168.203.32@tcp:13: Request processed in 162us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460358.327271:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:3.0:1788460358.327939:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788460359.052453:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460359.180431:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482548480:0@lo:400: 00000100:00100000:3.0:1788460359.180508:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460359.180571:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460359.180578:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482548352:0@lo:400: 00000100:00100000:3.0:1788460359.180618:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460359.180885:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482548096:0@lo:400: 00000100:00100000:1.0:1788460359.180924:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460359.180958:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482548608:0@lo:400: 00000100:00100000:1.0:1788460359.180978:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460359.181005:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788460359.181011:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482548224:0@lo:400: 00000100:00100000:1.0:1788460359.181032:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460359.181061:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482548736:0@lo:400: 00000100:00100000:1.0:1788460359.181080:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460359.181112:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548352 00000100:00100000:1.0:1788460359.181120:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548352 00000100:00100000:1.0:1788460359.181203:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548608 00000100:00100000:1.0:1788460359.181207:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548608 00000100:00100000:1.0:1788460359.181222:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548224 00000100:00100000:1.0:1788460359.181224:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548224 00000100:00100000:1.0:1788460359.181238:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460359.181246:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482548352:12345-0@lo:400: 00000100:00100000:1.0:1788460359.181296:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482548352:12345-0@lo:400: Request processed in 51us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460359.181303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460359.181318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460359.181324:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482548608:12345-0@lo:400: 00000100:00100000:1.0:1788460359.181354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482548608:12345-0@lo:400: Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460359.181360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460359.181370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460359.181376:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482548224:12345-0@lo:400: 00000100:00100000:1.0:1788460359.181399:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482548224:12345-0@lo:400: Request processed in 23us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460359.181404:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460359.181426:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548480 00000100:00100000:1.0:1788460359.181429:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548480 00000100:00100000:1.0:1788460359.181476:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548736 00000100:00100000:1.0:1788460359.181480:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548736 00000100:00100000:1.0:1788460359.181494:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460359.181499:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482548480:12345-0@lo:400: 00000100:00100000:1.0:1788460359.181529:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482548480:12345-0@lo:400: Request processed in 30us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460359.181534:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460359.181543:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460359.181548:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482548736:12345-0@lo:400: 00000100:00100000:1.0:1788460359.181777:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482548736:12345-0@lo:400: Request processed in 228us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460359.181783:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788460359.181801:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460359.181804:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460359.181806:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460359.181839:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482548224:0@lo:400: 00010000:00080000:1.0:1788460359.181851:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fcd3e680 x1875336482548736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460359.181860:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788460359.181874:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482548736:0@lo:400: 00000100:00100000:1.0:1788460359.181884:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482548608:0@lo:400: 00000100:00100000:1.0:1788460359.181913:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482548352:0@lo:400: 00010000:00080000:1.0:1788460359.181924:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fcd3c380 x1875336482548480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460359.181933:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482548480:0@lo:400: 00000100:00100000:3.0:1788460359.182063:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548096 00000100:00100000:3.0:1788460359.182068:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548096 00000100:00100000:3.0:1788460359.182095:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788460359.182102:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482548096:12345-0@lo:400: 00000100:00100000:3.0:1788460359.182135:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482548096:12345-0@lo:400: Request processed in 34us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460359.182141:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788460359.182280:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460359.182289:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482548864:0@lo:13: 00000100:00100000:1.0:1788460359.182315:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460359.182346:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548864 00000100:00100000:1.0:1788460359.182349:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548864 00000100:00100000:1.0:1788460359.182376:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460359.182383:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482548864:12345-0@lo:13: 00002000:00000024:1.0:1788460359.182396:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460359.182427:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482548864:12345-0@lo:13: Request processed in 45us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460359.182433:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460359.183015:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482548096:0@lo:400: 00000100:00100000:1.0:1788460359.183051:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482548992:0@lo:13: 00000100:00100000:1.0:1788460359.183079:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788460359.183113:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb96d80 x1875336482548864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460359.183129:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482548864:0@lo:13: 00000100:00100000:2.0:1788460359.184990:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482548992 00000100:00100000:2.0:1788460359.185005:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482548992 00000100:00100000:2.0:1788460359.185098:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788460359.185109:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482548992:12345-0@lo:13: 00002000:00000024:2.0:1788460359.185133:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460359.185239:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482548992:12345-0@lo:13: Request processed in 132us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460359.185252:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788460359.187969:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0262a00 x1875336482548992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460359.187996:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482548992:0@lo:13: 00010000:00010000:0.0:1788460360.088683:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788460360.281282:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000001:00100000:1.0:1788460360.306358:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000001:02000400:0.0:1788460360.774973:0:8325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788460361.103852:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788460361.289627:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000100:00100000:3.0:1788460361.450747:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460361.450838:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460361.450884:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460361.450913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601728 00000100:00100000:2.0:1788460361.450925:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601728 00000100:00100000:3.0:1788460361.450931:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460361.450998:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:2.0:1788460361.451010:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462601728:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1788460361.451057:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462602112 00000100:00100000:0.0:1788460361.451063:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462602112 00000100:00100000:0.0:1788460361.451103:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601984 00000100:00100000:0.0:1788460361.451106:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601984 00000100:00100000:0.0:1788460361.451122:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1788460361.451129:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462602112:12345-192.168.203.32@tcp:400: 00000100:00100000:2.0:1788460361.451273:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462601728:12345-192.168.203.32@tcp:400: Request processed in 264us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460361.451524:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462602112:12345-192.168.203.32@tcp:400: Request processed in 394us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460361.451531:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1788460361.451547:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1788460361.451554:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462601984:12345-192.168.203.32@tcp:400: 00000100:00100000:0.0:1788460361.451572:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462601984:12345-192.168.203.32@tcp:400: Request processed in 20us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460361.451576:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00080000:0.0:1788460361.451587:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460361.451590:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460361.451973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462601856 00000100:00100000:1.0:1788460361.451978:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462601856 00000100:00080000:0.0:1788460361.452095:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460361.452200:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1788460361.452210:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462601856:12345-192.168.203.32@tcp:400: 00000100:00100000:1.0:1788460361.452244:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462601856:12345-192.168.203.32@tcp:400: Request processed in 37us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460361.452258:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1788460361.452795:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 145 00010000:00010000:1.0:1788460362.125307:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460363.149029:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788460363.770931:0:8473:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf62c3780 20000000:00000080:2.0:1788460363.770948:0:8473:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff964fc12c2400 uarg=0000000000000000 20000000:01000000:2.0:1788460363.770981:0:8473:0:(mgs_llog.c:2012:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788460363.770983:0:8473:0:(mgs_llog.c:6075:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788460363.770986:0:8473:0:(mgs_llog.c:6106:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788460363.770991:0:8473:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788460363.771002:0:8473:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788460363.771030:0:8473:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788460363.771033:0:8473:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788460363.771290:0:8473:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788460363.771294:0:8473:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788460363.772056:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788460363.772458:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788460363.772508:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788460363.772558:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788460363.772572:0:8473:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788460363.772574:0:8473:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788460363.774109:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788460363.774590:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788460363.774648:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788460363.774837:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788460363.774856:0:8473:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788460363.774858:0:8473:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788460363.775536:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788460363.775884:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788460363.775923:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788460363.775958:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788460363.775971:0:8473:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788460363.775973:0:8473:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788460363.776905:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788460363.777542:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788460363.777608:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788460363.777643:0:8473:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1788460363.777771:0:8473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788460363.777790:0:8473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777807:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7051 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777814:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b705f expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777821:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7097 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777828:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70cf expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777848:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70eb expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777855:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b70f9 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777862:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7107 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777869:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7123 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777876:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b714d expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777886:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777935:0:8473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777944:0:8473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777982:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.777998:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 9 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.778113:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549120:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460363.778234:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.778242:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.778252:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549248:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460363.778281:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b714d expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.778289:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b714d expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.778297:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549376:0@lo:104: 00000100:00100000:1.0:1788460363.778334:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460363.778374:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7123 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.778381:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7123 expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.778387:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482549376 00000100:00100000:1.0:1788460363.778388:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549504:0@lo:104: 00000100:00100000:2.0:1788460363.778393:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482549376 00000100:00100000:2.0:1788460363.778446:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460363.778456:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482549376:12345-0@lo:104: 00010000:00010000:2.0:1788460363.778468:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.778517:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460363.778522:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482549376:12345-0@lo:104: Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460363.778529:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460363.778535:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460363.778546:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482549504 00000100:00100000:2.0:1788460363.778550:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482549504 00010000:00010000:1.0:1788460363.778557:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7107 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.778565:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788460363.778566:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7107 expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.778570:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482549504:12345-0@lo:104: 00010000:00010000:2.0:1788460363.778577:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.778580:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549632:0@lo:104: 00000100:00100000:1.0:1788460363.778601:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460363.778607:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460363.778618:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482549504:12345-0@lo:104: Request processed in 47us (82us total) trans 0 rc 0/0 00010000:00010000:1.0:1788460363.778620:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b70f9 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.778625:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788460363.778628:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b70f9 expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.778636:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549760:0@lo:104: 00000100:00100000:2.0:1788460363.778637:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482549632 00000100:00100000:2.0:1788460363.778639:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482549632 00000100:00100000:2.0:1788460363.778651:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460363.778655:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460363.778674:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b70eb expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.778681:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b70eb expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.778689:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549888:0@lo:104: 00000100:00100000:1.0:1788460363.778708:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460363.778737:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b70cf expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.778745:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b70cf expref: 22 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.778753:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550016:0@lo:104: 00000100:00100000:2.0:1788460363.778854:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482549632:12345-0@lo:104: 00010000:00010000:2.0:1788460363.778861:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.778913:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788460363.778918:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482549632:12345-0@lo:104: Request processed in 68us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460363.778918:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460363.778924:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788460363.778937:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7097 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.778941:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788460363.778948:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482549760 00000100:00100000:2.0:1788460363.778951:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482549760 00010000:00010000:1.0:1788460363.778954:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7097 expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.778961:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482549888 00000100:00100000:2.0:1788460363.778963:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482549888 00000100:00100000:1.0:1788460363.778963:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550144:0@lo:104: 00000100:00100000:2.0:1788460363.778971:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550016 00000100:00100000:2.0:1788460363.778973:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550016 00000100:00100000:2.0:1788460363.778983:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460363.778983:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460363.778988:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8473:x1875336482549760:12345-0@lo:104: 00010000:00010000:2.0:1788460363.778996:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.778998:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b705f expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.779037:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788460363.779043:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8473:x1875336482549760:12345-0@lo:104: Request processed in 54us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460363.779056:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788460363.779067:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550144 00000100:00100000:2.0:1788460363.779070:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550144 00000100:00100000:2.0:1788460363.779082:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788460363.779088:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8473:x1875336482549888:12345-0@lo:104: 00010000:00010000:2.0:1788460363.779094:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.779120:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788460363.779125:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8473:x1875336482549888:12345-0@lo:104: Request processed in 38us (417us total) trans 0 rc 0/0 00010000:00010000:1.0:1788460363.779129:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b705f expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.779131:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460363.779139:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550272:0@lo:104: 00000100:00100000:2.0:1788460363.779142:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788460363.779147:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd277450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:8473:x1875336482550016:12345-0@lo:104: 00010000:00010000:2.0:1788460363.779153:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.779159:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460363.779193:0:8473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7051 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.779202:0:8473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7051 expref: 22 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.779207:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788460363.779210:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550400:0@lo:104: 00000100:00100000:2.0:1788460363.779212:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd277450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:8473:x1875336482550016:12345-0@lo:104: Request processed in 65us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460363.779217:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460363.779228:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460363.779241:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550272 00000100:00100000:2.0:1788460363.779244:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550272 00000100:00100000:1.0:1788460363.779244:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460363.779253:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550400 00000100:00100000:2.0:1788460363.779255:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550400 00000100:00100000:1.0:1788460363.779260:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549376:0@lo:104: 00000100:00100000:2.0:1788460363.779264:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460363.779268:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8473:x1875336482550144:12345-0@lo:104: 00000100:00100000:1.0:1788460363.779269:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549504:0@lo:104: 00000100:00100000:1.0:1788460363.779276:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549632:0@lo:104: 00000100:00100000:1.0:1788460363.779282:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549760:0@lo:104: 00010000:00010000:2.0:1788460363.779283:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.779288:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549888:0@lo:104: 00000100:00100000:1.0:1788460363.779300:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550016:0@lo:104: 00010000:00010000:2.0:1788460363.779322:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788460363.779327:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8473:x1875336482550144:12345-0@lo:104: Request processed in 59us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460363.779331:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550144:0@lo:104: 00000100:00100000:2.0:1788460363.779333:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460363.779346:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460363.779351:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:8473:x1875336482550272:12345-0@lo:104: 00010000:00010000:2.0:1788460363.779358:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.779400:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788460363.779405:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:8473:x1875336482550272:12345-0@lo:104: Request processed in 55us (245us total) trans 0 rc 0/0 00010000:00010000:0.0:1788460363.779489:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788460363.779496:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779502:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.779506:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779514:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.779520:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.779525:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.779552:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779567:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.779586:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779593:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4200/0x889bb893541b714d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779605:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788460363.779608:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779614:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102166400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.779617:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779623:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.779629:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.779634:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.779645:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779651:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.779672:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779679:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102166400/0x889bb893541b7123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b712a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779696:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788460363.779699:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779705:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.779708:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779715:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.779721:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.779726:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.779738:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779743:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.779756:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779762:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b7107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b710e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779771:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788460363.779774:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779789:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.779792:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779799:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.779805:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.779810:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.779823:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779829:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.779834:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779840:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b70f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7100 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779849:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788460363.779852:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779857:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102166c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.779860:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779877:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.779883:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.779889:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.779902:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779907:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.779912:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779918:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102166c00/0x889bb893541b70eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b70f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779927:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788460363.779930:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779936:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.779939:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779945:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.779952:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.779965:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.779977:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779983:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.779987:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.779994:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b70cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b70d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780015:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460363.780018:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780024:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166e000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.780027:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780033:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.780039:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.780044:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.780055:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780061:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.780071:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780077:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c166e000/0x889bb893541b7097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b709e expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780086:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460363.780089:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780094:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102166200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460363.780097:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780103:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460363.780108:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460363.780114:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460363.780126:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780132:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460363.780136:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780142:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102166200/0x889bb893541b705f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7066 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780151:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460363.780158:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460363.780160:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460363.780168:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460363.780217:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482550528:0@lo:103: 00000100:00100000:0.0:1788460363.780264:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780286:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482551040:0@lo:103: 00000100:00100000:0.0:1788460363.780307:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780328:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788460363.780333:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482550656:0@lo:103: 00000100:00100000:0.0:1788460363.780353:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780367:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482551168:0@lo:103: 00000100:00100000:0.0:1788460363.780386:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780422:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482550912:0@lo:103: 00000100:00100000:0.0:1788460363.780446:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780456:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482551424:0@lo:103: 00000100:00100000:0.0:1788460363.780472:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780483:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788460363.780488:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482550784:0@lo:103: 00000100:00100000:0.0:1788460363.780506:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780515:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482551296:0@lo:103: 00000100:00100000:0.0:1788460363.780529:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460363.780546:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550528 00000100:00100000:0.0:1788460363.780551:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550528 00010000:00010000:0.0:1788460363.780573:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b714d expref: 23 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551040 00000100:00100000:0.0:1788460363.780596:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551040 00010000:00010000:0.0:1788460363.780606:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b70eb expref: 24 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780617:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550656 00000100:00100000:0.0:1788460363.780619:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550656 00010000:00010000:0.0:1788460363.780628:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7123 expref: 25 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551168 00000100:00100000:0.0:1788460363.780638:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551168 00010000:00010000:0.0:1788460363.780646:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b70cf expref: 26 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780655:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550912 00000100:00100000:0.0:1788460363.780656:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550912 00010000:00010000:0.0:1788460363.780665:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b70f9 expref: 27 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780673:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551424 00000100:00100000:0.0:1788460363.780675:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551424 00010000:00010000:0.0:1788460363.780686:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b705f expref: 28 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780694:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482550784 00000100:00100000:0.0:1788460363.780697:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482550784 00010000:00010000:0.0:1788460363.780705:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7107 expref: 29 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780713:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551296 00000100:00100000:0.0:1788460363.780716:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551296 00010000:00010000:0.0:1788460363.780723:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7097 expref: 30 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460363.780745:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460363.780751:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+30:3318:x1875336482550528:12345-0@lo:103: 00010000:00010000:0.0:1788460363.780762:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.780767:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b714d expref: 30 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780775:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b714d expref: 30 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780788:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167e00/0x889bb893541b7154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b714d expref: 30 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780800:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.780827:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+29:3318:x1875336482550528:12345-0@lo:103: Request processed in 76us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.780833:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460363.780850:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460363.780855:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+28:3318:x1875336482551040:12345-0@lo:103: 00010000:00010000:0.0:1788460363.780862:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.780866:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b70eb expref: 28 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780874:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b70eb expref: 28 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780883:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167800/0x889bb893541b70f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b70eb expref: 28 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780901:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.780921:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+27:3318:x1875336482551040:12345-0@lo:103: Request processed in 66us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.780927:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460363.780940:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788460363.780946:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+26:3318:x1875336482550656:12345-0@lo:103: 00010000:00010000:0.0:1788460363.780953:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.780957:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7123 expref: 26 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780965:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7123 expref: 26 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780974:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166ee00/0x889bb893541b712a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7123 expref: 26 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.780983:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.781000:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+25:3318:x1875336482550656:12345-0@lo:103: Request processed in 55us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.781019:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788460363.781031:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788460363.781036:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+24:3318:x1875336482551168:12345-0@lo:103: 00010000:00010000:0.0:1788460363.781043:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.781047:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b70cf expref: 24 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781055:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b70cf expref: 24 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781070:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167c00/0x889bb893541b70d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b70cf expref: 24 pid: 5834 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781079:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.781100:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482551168:12345-0@lo:103: Request processed in 64us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.781106:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788460363.781118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460363.781123:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ea552050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:3317:x1875336482550912:12345-0@lo:103: 00010000:00010000:0.0:1788460363.781130:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.781134:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b70f9 expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781141:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b70f9 expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781149:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166ea00/0x889bb893541b7100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b70f9 expref: 22 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781157:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.781207:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ea552050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:3317:x1875336482550912:12345-0@lo:103: Request processed in 83us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.781213:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460363.781242:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460363.781248:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3317:x1875336482551424:12345-0@lo:103: 00010000:00010000:0.0:1788460363.781254:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.781258:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b705f expref: 20 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781273:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b705f expref: 20 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781282:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.781303:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3317:x1875336482551424:12345-0@lo:103: Request processed in 55us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.781308:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460363.781320:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460363.781325:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:3317:x1875336482550784:12345-0@lo:103: 00010000:00010000:0.0:1788460363.781332:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.781336:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7107 expref: 19 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781343:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7107 expref: 19 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781352:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166f000/0x889bb893541b710e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7107 expref: 19 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781360:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.781379:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3317:x1875336482550784:12345-0@lo:103: Request processed in 55us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.781385:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460363.781395:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460363.781400:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:3317:x1875336482551296:12345-0@lo:103: 00010000:00010000:0.0:1788460363.781407:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460363.781411:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7097 expref: 17 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781423:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7097 expref: 17 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781432:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4600/0x889bb893541b709e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7097 expref: 17 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460363.781440:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460363.781461:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:3317:x1875336482551296:12345-0@lo:103: Request processed in 61us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460363.781467:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460363.781503:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482550784:0@lo:103: 00000100:00100000:0.0:1788460363.781510:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482551296:0@lo:103: 00000100:00100000:0.0:1788460363.781518:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482550912:0@lo:103: 00000100:00100000:0.0:1788460363.781525:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482551424:0@lo:103: 00000100:00100000:0.0:1788460363.781556:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482550656:0@lo:103: 00000100:00100000:0.0:1788460363.781564:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482551168:0@lo:103: 00000100:00100000:0.0:1788460363.781571:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482550528:0@lo:103: 00000100:00100000:0.0:1788460363.781578:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482551040:0@lo:103: 00000100:00100000:2.0:1788460363.781914:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460363.781935:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788460363.781944:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482550400:12345-0@lo:104: 00010000:00010000:2.0:1788460363.781955:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.782018:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460363.782023:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8473:x1875336482550400:12345-0@lo:104: Request processed in 82us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460363.782029:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788460363.782047:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460363.782052:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.782066:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166fe00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460363.782070:0:7659:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.782077:0:7659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460363.782084:0:7659:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460363.782089:0:7659:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460363.782113:0:7659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.782120:0:7659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460363.782131:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.782138:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c166fe00/0x889bb893541b7051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7058 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.782151:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460363.782154:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460363.782155:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460363.782266:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166fa00/0x889bb893541b7066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b705f expref: 15 pid: 5836 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460363.782276:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550272:0@lo:104: 00000100:00100000:1.0:1788460363.782287:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482550400:0@lo:104: 00010000:00010000:3.0:1788460363.782435:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460363.782698:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460363.782712:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482551552:0@lo:103: 00000100:00100000:0.0:1788460363.782750:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460363.782803:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460363.782954:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551552 00000100:00100000:2.0:1788460363.782961:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551552 00010000:00010000:2.0:1788460363.782986:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7051 expref: 15 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.783024:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788460363.783040:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:3319:x1875336482551552:12345-0@lo:103: 00010000:00010000:2.0:1788460363.783050:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460363.783054:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7051 expref: 15 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.783063:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7051 expref: 15 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.783078:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7051 expref: 15 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.783088:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460363.783214:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:3319:x1875336482551552:12345-0@lo:103: Request processed in 175us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460363.783219:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788460363.783479:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0261f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482551552:0@lo:103: 00000100:00100000:3.0:1788460363.787580:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460363.787594:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549120:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460363.787607:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8473:1875336482549248:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460363.787657:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1788460363.787657:0:8473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.787726:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462602240 00000100:00100000:2.0:1788460363.787733:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462602240 00010000:00010000:2.0:1788460363.787767:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 10 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.787802:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462602368 00000100:00100000:2.0:1788460363.787806:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462602368 00010000:00010000:2.0:1788460363.787818:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 11 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460363.787842:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1788460363.787851:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+11:2379:x1875336462602240:12345-192.168.203.32@tcp:103: 00010000:00010000:2.0:1788460363.787864:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460363.787869:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 11 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.787899:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 11 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.787916:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4400/0x889bb893541b7169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1159 expref: 11 pid: 5834 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.787930:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460363.787971:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2379:x1875336462602240:12345-192.168.203.32@tcp:103: Request processed in 122us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460363.787976:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1788460363.787990:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1788460363.787994:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:2379:x1875336462602368:12345-192.168.203.32@tcp:103: 00010000:00010000:2.0:1788460363.787999:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460363.788016:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788026:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788037:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008c00/0x889bb893541b7162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1152 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788046:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788054:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788079:0:7669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788086:0:7669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788092:0:7669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788099:0:7669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788105:0:7669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166ec00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460363.788109:0:7669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788117:0:7669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788128:0:7669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460363.788137:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460363.788156:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:2379:x1875336462602368:12345-192.168.203.32@tcp:103: Request processed in 160us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460363.788162:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00010000:00010000:1.0:1788460363.788439:0:8473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.788447:0:8473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460363.788454:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166ec00/0x889bb893541b71a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460364.173218:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460364.300744:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460364.300768:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482551680:0@lo:13: 00000100:00100000:2.0:1788460364.300866:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460364.301024:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551680 00000100:00100000:1.0:1788460364.301033:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551680 00000100:00100000:1.0:1788460364.301098:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460364.301108:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482551680:12345-0@lo:13: 00002000:00000024:1.0:1788460364.301153:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460364.301301:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482551680:12345-0@lo:13: Request processed in 194us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460364.301309:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788460364.301773:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788460364.301805:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3d0700 x1875336482551680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460364.301836:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482551680:0@lo:13: 00000100:00100000:2.0:1788460364.302621:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482552064:0@lo:400: 00000100:00100000:2.0:1788460364.302665:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460364.302695:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460364.302701:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482552192:0@lo:400: 00000100:00100000:2.0:1788460364.302724:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460364.302759:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552064 00000100:00100000:2.0:1788460364.302765:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552064 00000100:00100000:2.0:1788460364.302810:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788460364.302819:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482552064:12345-0@lo:400: 00000100:00100000:2.0:1788460364.302876:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482552064:12345-0@lo:400: Request processed in 59us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460364.302884:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788460364.302904:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460364.302922:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482552064:0@lo:400: 00000100:00100000:1.0:1788460364.303263:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482551936:0@lo:400: 00000100:00100000:1.0:1788460364.303293:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460364.303324:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460364.303329:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482551808:0@lo:400: 00000100:00100000:1.0:1788460364.303349:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460364.303375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551936 00000100:00100000:1.0:1788460364.303379:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551936 00000100:00100000:1.0:1788460364.303402:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482551808 00000100:00100000:1.0:1788460364.303405:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482551808 00000100:00100000:1.0:1788460364.303418:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460364.303424:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482551936:12345-0@lo:400: 00000100:00100000:1.0:1788460364.303458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482551936:12345-0@lo:400: Request processed in 34us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460364.303464:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460364.303476:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460364.303482:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482551808:12345-0@lo:400: 00000100:00100000:1.0:1788460364.303507:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482551808:12345-0@lo:400: Request processed in 24us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460364.303512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460364.303550:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482551808:0@lo:400: 00000100:00100000:1.0:1788460364.303561:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0260700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482551936:0@lo:400: 00000100:00080000:2.0:1788460364.303722:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460364.304067:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552192 00000100:00100000:0.0:1788460364.304072:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552192 00000100:00100000:0.0:1788460364.304109:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460364.304116:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482552192:12345-0@lo:400: 00000100:00100000:0.0:1788460364.304172:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482552192:12345-0@lo:400: Request processed in 56us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460364.304196:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788460364.305380:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788460364.306925:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb94380 x1875336482552192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460364.306941:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482552192:0@lo:400: 00000100:00100000:1.0:1788460364.307052:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460364.307065:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482552320:0@lo:13: 00000100:00100000:1.0:1788460364.307130:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460364.308085:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552320 00000100:00100000:2.0:1788460364.308094:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552320 00000100:00100000:2.0:1788460364.308160:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460364.308170:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482552320:12345-0@lo:13: 00002000:00000024:2.0:1788460364.308288:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460364.308401:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482552320:12345-0@lo:13: Request processed in 209us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460364.308409:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788460364.310065:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb94a80 x1875336482552320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460364.310089:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482552320:0@lo:13: 00010000:00010000:2.0:1788460365.199192:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788460365.708534:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788460365.708542:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650efb15800 from 39 10000000:01000000:0.0:1788460365.708548:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788460365.708604:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.708616:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.708627:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460365.708649:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552448:0@lo:101: 00000100:00100000:0.0:1788460365.708715:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.708843:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.709393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552448 00000100:00100000:1.0:1788460365.709404:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552448 00000100:00100000:1.0:1788460365.709449:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788460365.709458:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+14:5839:x1875336482552448:12345-0@lo:101: 00010000:00010000:1.0:1788460365.709473:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460365.709498:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166ec00/0x889bb893541b71af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b71a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.709524:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166ec00/0x889bb893541b71af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b71a8 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.709536:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166ec00/0x889bb893541b71af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b71a8 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.709545:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166ec00, rc 0) 00000100:00100000:1.0:1788460365.709652:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552448:12345-0@lo:101: Request processed in 194us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.709658:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788460365.714095:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552448:0@lo:101: 00010000:00010000:0.0:1788460365.714126:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.714139:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460365.715626:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788460365.718449:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460365.718731:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788460365.718776:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:0.0:1788460365.718812:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:0.0:1788460365.721384:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:0.0:1788460365.721464:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:0.0:1788460365.721530:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:0.0:1788460365.721566:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:0.0:1788460365.721601:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:0.0:1788460365.721652:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:0.0:1788460365.721689:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:0.0:1788460365.721723:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:0.0:1788460365.721769:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:0.0:1788460365.721805:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:0.0:1788460365.723275:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:0.0:1788460365.723370:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:0.0:1788460365.723410:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:0.0:1788460365.723444:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:0.0:1788460365.723506:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:0.0:1788460365.723544:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:0.0:1788460365.723582:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:0.0:1788460365.723634:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:0.0:1788460365.723674:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:0.0:1788460365.723712:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:0.0:1788460365.723766:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:0.0:1788460365.723807:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 128 off12440 00000040:00080000:0.0:1788460365.724070:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12664 00000040:00080000:0.0:1788460365.724121:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12888 00000040:00080000:0.0:1788460365.724169:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off12968 00000040:00080000:0.0:1788460365.724227:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13192 00000040:00080000:0.0:1788460365.724274:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13416 00000040:00080000:0.0:1788460365.724310:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13504 00000040:00080000:0.0:1788460365.724345:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13632 00000040:00080000:0.0:1788460365.725167:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13776 00000040:00080000:0.0:1788460365.725245:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13904 00000040:00080000:0.0:1788460365.725277:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14128 00000040:00080000:0.0:1788460365.725324:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14352 00000040:00080000:0.0:1788460365.725359:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14432 00000040:00080000:0.0:1788460365.725451:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14656 00000040:00080000:0.0:1788460365.725459:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788460365.727209:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552576:0@lo:501: 00000100:00100000:0.0:1788460365.727275:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.727327:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.727728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552576 00000100:00100000:2.0:1788460365.727736:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552576 00000100:00100000:2.0:1788460365.727839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788460365.727849:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552576:12345-0@lo:501: 00000100:00100000:2.0:1788460365.729618:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552576:12345-0@lo:501: Request processed in 1764us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.729630:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788460365.729733:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552576:0@lo:501: 00000100:00100000:0.0:1788460365.729780:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552704:0@lo:503: 00000100:00100000:0.0:1788460365.729835:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.734174:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.734294:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552704 00000100:00100000:1.0:1788460365.734305:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552704 00000100:00100000:1.0:1788460365.734444:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788460365.734454:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552704:12345-0@lo:503: 00000100:00100000:1.0:1788460365.734726:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552704:12345-0@lo:503: Request processed in 274us (4890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.734745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788460365.735003:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552704:0@lo:503: 00000040:00080000:2.0:1788460365.736661:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460365.736747:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552832:0@lo:502: 00000100:00100000:2.0:1788460365.736834:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.737001:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.737476:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552832 00000100:00100000:1.0:1788460365.737484:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552832 00000100:00100000:1.0:1788460365.737532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788460365.737542:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552832:12345-0@lo:502: 00000100:00100000:1.0:1788460365.737784:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552832:12345-0@lo:502: Request processed in 243us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.737792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788460365.737889:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552832:0@lo:502: 00000040:00080000:0.0:1788460365.738156:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788460365.738252:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:0.0:1788460365.738287:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:0.0:1788460365.738347:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:0.0:1788460365.738385:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:0.0:1788460365.738434:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:0.0:1788460365.738469:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:0.0:1788460365.738501:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:0.0:1788460365.738548:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:0.0:1788460365.738585:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:0.0:1788460365.738619:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:0.0:1788460365.738666:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:0.0:1788460365.738703:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:0.0:1788460365.738750:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:0.0:1788460365.738798:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:0.0:1788460365.738834:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:0.0:1788460365.738867:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:0.0:1788460365.738931:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:0.0:1788460365.738968:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:0.0:1788460365.739016:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:0.0:1788460365.739067:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:0.0:1788460365.739105:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:0.0:1788460365.739140:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:0.0:1788460365.739226:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:0.0:1788460365.739261:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 128 off12440 00000040:00080000:0.0:1788460365.739292:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12664 00000040:00080000:0.0:1788460365.739338:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12888 00000040:00080000:0.0:1788460365.739373:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off12968 00000040:00080000:0.0:1788460365.739406:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13192 00000040:00080000:0.0:1788460365.739451:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13416 00000040:00080000:0.0:1788460365.739484:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13504 00000040:00080000:0.0:1788460365.739516:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13632 00000040:00080000:0.0:1788460365.739548:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13776 00000040:00080000:0.0:1788460365.739610:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13904 00000040:00080000:0.0:1788460365.739644:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14128 00000040:00080000:0.0:1788460365.739686:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14352 00000040:00080000:0.0:1788460365.739720:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14432 00000040:00080000:0.0:1788460365.739752:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14656 00000040:00080000:0.0:1788460365.739799:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14880 00000040:00080000:0.0:1788460365.739836:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 120 off15000 00000100:00100000:0.0:1788460365.739877:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552960:0@lo:502: 00000100:00100000:0.0:1788460365.739944:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.740004:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460365.740420:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482552960 00000100:00100000:3.0:1788460365.740428:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482552960 00000100:00100000:3.0:1788460365.740480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788460365.740489:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552960:12345-0@lo:502: 00000100:00100000:3.0:1788460365.740706:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482552960:12345-0@lo:502: Request processed in 218us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460365.740714:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788460365.741745:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482552960:0@lo:502: 00000040:00080000:0.0:1788460365.741983:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 224 off15224 00000040:00080000:0.0:1788460365.742009:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000040:00080000:3.0:1788460365.752454:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 42 count 42 00000020:01000000:0.0:1788460365.752764:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788460365.752780:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788460365.752789:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.752802:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460365.752825:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788460365.752828:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788460365.752831:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788460365.752876:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.752886:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.752897:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460365.752921:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553088:0@lo:101: 00000100:00100000:0.0:1788460365.752985:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.753047:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460365.753326:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553088 00000100:00100000:3.0:1788460365.753334:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553088 00000100:00100000:3.0:1788460365.753382:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788460365.753392:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+15:5839:x1875336482553088:12345-0@lo:101: 00010000:00010000:3.0:1788460365.753416:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460365.753427:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5800/0x889bb893541b71bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b71b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.753450:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5800/0x889bb893541b71bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b71b6 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.753462:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5800/0x889bb893541b71bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b71b6 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.753471:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5800, rc 0) 00000100:00100000:3.0:1788460365.753518:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553088:12345-0@lo:101: Request processed in 128us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460365.753525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788460365.753654:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553088:0@lo:101: 00010000:00010000:2.0:1788460365.753668:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.753677:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460365.754097:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788460365.754418:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460365.754635:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788460365.754679:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:2.0:1788460365.754714:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:2.0:1788460365.754780:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:2.0:1788460365.754817:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:2.0:1788460365.754852:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:2.0:1788460365.754916:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:2.0:1788460365.754924:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788460365.754984:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553216:0@lo:501: 00000100:00100000:2.0:1788460365.755043:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.755079:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.755162:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553216 00000100:00100000:1.0:1788460365.755168:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553216 00000100:00100000:1.0:1788460365.755232:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788460365.755241:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553216:12345-0@lo:501: 00000100:00100000:1.0:1788460365.755445:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553216:12345-0@lo:501: Request processed in 205us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.755453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788460365.755811:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553216:0@lo:501: 00000100:00100000:2.0:1788460365.755841:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553344:0@lo:503: 00000100:00100000:2.0:1788460365.756065:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.756226:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.756721:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553344 00000100:00100000:1.0:1788460365.756727:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553344 00000100:00100000:1.0:1788460365.756768:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788460365.756776:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553344:12345-0@lo:503: 00000100:00100000:1.0:1788460365.757175:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553344:12345-0@lo:503: Request processed in 399us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460365.757269:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553344:0@lo:503: 00000040:00080000:0.0:1788460365.757736:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460365.757800:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553472:0@lo:502: 00000100:00100000:0.0:1788460365.758066:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460365.758152:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788460365.758286:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.761198:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553472 00000100:00100000:1.0:1788460365.761212:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553472 00000100:00100000:1.0:1788460365.761252:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788460365.761260:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553472:12345-0@lo:502: 00000100:00100000:1.0:1788460365.761593:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553472:12345-0@lo:502: Request processed in 333us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.761601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788460365.763205:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553472:0@lo:502: 00000040:00080000:1.0:1788460365.763576:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788460365.763633:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:1.0:1788460365.763664:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788460365.763710:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788460365.763747:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788460365.763779:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788460365.764065:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:1.0:1788460365.764110:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788460365.764161:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 120 off9752 00000100:00100000:1.0:1788460365.764243:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553600:0@lo:502: 00000100:00100000:1.0:1788460365.764307:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460365.764349:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.764438:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553600 00000100:00100000:2.0:1788460365.764444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553600 00000100:00100000:2.0:1788460365.764483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788460365.764492:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553600:12345-0@lo:502: 00000100:00100000:2.0:1788460365.764667:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553600:12345-0@lo:502: Request processed in 176us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.764675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788460365.764761:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553600:0@lo:502: 00000040:00080000:1.0:1788460365.765065:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9976 00000040:00080000:1.0:1788460365.765075:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788460365.766497:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460365.766508:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460365.766510:0:8492:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788460365.766515:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788460365.766534:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460365.766538:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460365.766539:0:8492:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788460365.766542:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788460365.766660:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788460365.766670:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788460365.766680:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.766691:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460365.766701:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788460365.766709:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650efb15800 from 1 10000000:01000000:2.0:1788460365.766712:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788460365.766743:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.766751:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.766762:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460365.766783:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.766851:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.767064:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.767109:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553728 00000100:00100000:1.0:1788460365.767115:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553728 00000100:00100000:1.0:1788460365.767156:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788460365.767165:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+16:5839:x1875336482553728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460365.767207:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460365.767220:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166fa00/0x889bb893541b71cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b71c4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.767242:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166fa00/0x889bb893541b71cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b71c4 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.767252:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166fa00/0x889bb893541b71cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b71c4 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.767259:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166fa00, rc 0) 00000100:00100000:1.0:1788460365.767303:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482553728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.767310:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788460365.767480:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460365.767496:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.767505:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460365.767571:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.767598:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.767626:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.767700:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553856 00000100:00100000:2.0:1788460365.767705:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553856 00000100:00100000:2.0:1788460365.767738:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788460365.767744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482553856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.768213:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482553856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 468us (613us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460365.768220:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788460365.772086:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553856:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788460365.772116:0:5839:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788460365.772319:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.772387:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.772465:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.772639:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482553984 00000100:00100000:1.0:1788460365.772646:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482553984 00000100:00100000:1.0:1788460365.772725:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788460365.772734:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482553984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460365.773083:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482553984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (695us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460365.773091:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788460365.773238:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482553984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788460365.773284:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788460365.773292:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.773303:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460365.773315:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788460365.773317:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650f6139800 from 39 10000000:01000000:3.0:1788460365.773320:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788460365.773343:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.773351:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.773361:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460365.773375:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.773404:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.773717:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.773796:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482554112 00000100:00100000:2.0:1788460365.773801:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482554112 00000100:00100000:2.0:1788460365.773833:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788460365.773840:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:5839:x1875336482554112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460365.773849:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460365.774274:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008400/0x889bb893541b71d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b71d2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.774312:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008400/0x889bb893541b71d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b71d2 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.774324:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008400/0x889bb893541b71d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b71d2 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.774331:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008400, rc 0) 00000100:00100000:2.0:1788460365.774381:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 541us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.774388:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788460365.774470:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460365.774485:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.774505:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460365.775415:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 39 count 39 00000040:00080000:3.0:1788460365.776587:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460365.777633:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788460365.777694:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788460365.777728:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788460365.777775:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788460365.777812:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788460365.779937:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788460365.780021:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788460365.780058:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788460365.780109:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788460365.780143:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788460365.780170:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788460365.780526:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788460365.780561:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788460365.780588:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788460365.780625:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788460365.780656:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788460365.780683:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788460365.780720:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788460365.780749:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788460365.780775:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788460365.780811:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788460365.780838:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788460365.781130:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788460365.781213:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788460365.781248:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788460365.781274:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788460365.781327:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788460365.781363:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788460365.781396:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788460365.781449:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788460365.781481:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788460365.781507:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788460365.781532:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788460365.781568:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788460365.781595:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788460365.781631:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788460365.781666:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788460365.781759:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788460365.781767:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 38 count 39 00000100:00100000:3.0:1788460365.781879:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.781935:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.781968:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.782114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482554240 00000100:00100000:2.0:1788460365.782120:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482554240 00000100:00100000:2.0:1788460365.782163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788460365.782170:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.782373:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.782380:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788460365.782578:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.782610:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.782647:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.782706:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460365.782769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482554368 00000100:00100000:0.0:1788460365.782774:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482554368 00000100:00100000:2.0:1788460365.784288:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788460365.784303:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.784494:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.784502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788460365.784599:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460365.785117:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460365.785233:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554496:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.785273:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.785303:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.785430:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482554496 00000100:00100000:1.0:1788460365.785437:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482554496 00000100:00100000:1.0:1788460365.785464:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788460365.785471:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554496:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460365.785650:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554496:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 178us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.785667:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788460365.785872:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554496:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460365.786117:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788460365.786172:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788460365.786262:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788460365.786322:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788460365.786361:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788460365.786408:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788460365.786443:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788460365.786476:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788460365.786521:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788460365.786556:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788460365.786592:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788460365.786653:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788460365.786691:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788460365.786726:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788460365.786792:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788460365.786830:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788460365.786866:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788460365.786914:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788460365.786953:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788460365.787001:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788460365.787052:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788460365.787091:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788460365.787125:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788460365.787176:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788460365.787245:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788460365.787282:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788460365.787330:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788460365.787366:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788460365.787398:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788460365.787447:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788460365.787494:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788460365.787521:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788460365.787553:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788460365.787597:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788460365.787641:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788460365.787685:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788460365.787716:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788460365.787748:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788460365.787794:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788460365.787829:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788460365.787876:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554624:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.787950:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.788003:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.788167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482554624 00000100:00100000:2.0:1788460365.788174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482554624 00000100:00100000:2.0:1788460365.788249:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788460365.788258:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554624:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.788458:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554624:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 201us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.788466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788460365.789258:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554624:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460365.789344:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788460365.789354:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000040:00080000:0.0:1788460365.790853:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788460365.791434:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788460365.791447:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788460365.791457:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.791469:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460365.791481:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788460365.791483:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788460365.791486:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788460365.791519:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.791528:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.791537:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460365.791567:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.791623:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.791663:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460365.791747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482554752 00000100:00100000:0.0:1788460365.791762:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482554752 00000100:00100000:0.0:1788460365.791804:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788460365.791813:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:5839:x1875336482554752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460365.791826:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460365.791837:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c0030800/0x889bb893541b71e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b71e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.791859:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c0030800/0x889bb893541b71e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b71e0 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.792409:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c0030800/0x889bb893541b71e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b71e0 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.792418:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c0030800, rc 0) 00000100:00100000:0.0:1788460365.792469:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482554752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 658us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460365.792476:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788460365.793047:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460365.793063:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.793073:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460365.793660:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788460365.794871:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460365.795151:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788460365.795457:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788460365.795520:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788460365.795571:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788460365.795609:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788460365.795644:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788460365.795694:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788460365.795732:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788460365.795786:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788460365.796108:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788460365.796119:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:3.0:1788460365.796490:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.796554:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.796643:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.798443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482554880 00000100:00100000:2.0:1788460365.798456:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482554880 00000100:00100000:2.0:1788460365.798546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788460365.798556:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482554880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.798842:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482554880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.798850:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788460365.799280:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482554880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.799340:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.799383:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.802365:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.802551:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555008 00000100:00100000:2.0:1788460365.802561:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555008 00000100:00100000:2.0:1788460365.802602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788460365.802612:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482555008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.804520:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482555008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1903us (5129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.804533:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788460365.804796:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460365.805533:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460365.805606:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555136:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.805671:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.805704:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.807061:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555136 00000100:00100000:2.0:1788460365.807071:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555136 00000100:00100000:2.0:1788460365.807114:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788460365.807123:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482555136:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.807388:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482555136:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 266us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.807396:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788460365.807590:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555136:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460365.808093:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788460365.808147:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788460365.808205:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788460365.808257:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788460365.808293:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788460365.808340:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788460365.808384:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788460365.808420:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788460365.808452:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788460365.808497:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788460365.808532:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788460365.808578:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788460365.808617:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555264:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.808666:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.808701:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.810253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555264 00000100:00100000:2.0:1788460365.810266:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555264 00000100:00100000:2.0:1788460365.810324:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788460365.810333:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482555264:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.810573:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482555264:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 241us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.810581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788460365.810681:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555264:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460365.810782:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788460365.810800:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788460365.816829:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460365.816844:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460365.816847:0:8494:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788460365.816853:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788460365.817301:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460365.817306:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460365.817308:0:8494:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788460365.817312:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788460365.817547:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788460365.817561:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788460365.817572:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.817584:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460365.817595:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788460365.817597:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650f6139800 from 1 10000000:01000000:3.0:1788460365.817600:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788460365.817635:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.817644:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.817654:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460365.817677:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.817739:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.817782:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.817838:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555392 00000100:00100000:2.0:1788460365.817844:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555392 00000100:00100000:1.0:1788460365.818396:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788460365.818417:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:5839:x1875336482555392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460365.818432:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460365.818444:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166f800/0x889bb893541b71f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b71ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.818467:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166f800/0x889bb893541b71f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b71ee expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.818478:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166f800/0x889bb893541b71f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b71ee expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.818485:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166f800, rc 0) 00000100:00100000:1.0:1788460365.818541:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482555392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.818547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788460365.818627:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460365.818641:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.818649:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460365.818744:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.818772:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.818804:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.818850:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555520 00000100:00100000:2.0:1788460365.818855:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555520 00000100:00100000:2.0:1788460365.818897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788460365.818904:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482555520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.819375:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482555520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 470us (601us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460365.819382:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788460365.819465:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555520:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788460365.819478:0:5839:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788460365.819521:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.819545:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.819571:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.819609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555648 00000100:00100000:1.0:1788460365.819614:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555648 00000100:00100000:1.0:1788460365.819646:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788460365.819653:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482555648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460365.819787:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482555648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (240us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460365.819794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788460365.819854:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788460365.819893:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788460365.819901:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.819910:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460365.819919:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788460365.819921:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650c5118800 from 39 10000000:01000000:0.0:1788460365.819924:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788460365.819942:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.819950:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.819958:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460365.819979:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.820014:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.820044:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.820246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555776 00000100:00100000:1.0:1788460365.820251:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555776 00000100:00100000:1.0:1788460365.820270:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788460365.820282:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482555776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460365.820292:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460365.820302:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166f000/0x889bb893541b7203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b71fc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.820321:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166f000/0x889bb893541b7203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b71fc expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.820329:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166f000/0x889bb893541b7203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b71fc expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460365.820335:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166f000, rc 0) 00000100:00100000:1.0:1788460365.820366:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482555776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.820372:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788460365.820745:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460365.820758:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.820767:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460365.820797:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.820835:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460365.820966:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482555904 00000100:00100000:1.0:1788460365.820971:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482555904 00000100:00100000:1.0:1788460365.820999:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788460365.821006:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482555904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460365.821213:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482555904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.821219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788460365.821505:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460365.821520:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482555904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.821547:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.821586:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.821602:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.821652:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556032 00000100:00100000:1.0:1788460365.821656:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556032 00000100:00100000:1.0:1788460365.821675:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788460365.821681:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482556032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460365.821832:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482556032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.821844:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788460365.822327:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.822677:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8495:1875336482556160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460365.822718:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.822747:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460365.824103:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556160 00000100:00100000:3.0:1788460365.824114:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556160 00000100:00100000:3.0:1788460365.824193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788460365.824204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:8495:x1875336482556160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460365.824605:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:8495:x1875336482556160:12345-0@lo:502:llog_process_th.0 Request processed in 402us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460365.824629:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788460365.824735:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8495:1875336482556160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460365.824793:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8495:1875336482556288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460365.824852:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.825051:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460365.829108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556288 00000100:00100000:1.0:1788460365.829132:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556288 00000100:00100000:1.0:1788460365.829422:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788460365.829435:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:8495:x1875336482556288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460365.829814:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:8495:x1875336482556288:12345-0@lo:502:llog_process_th.0 Request processed in 382us (4960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460365.829822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788460365.829925:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8495:1875336482556288:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788460365.829960:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788460365.833464:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788460365.833482:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788460365.833494:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.833507:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460365.833519:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788460365.833522:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788460365.833524:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788460365.833578:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.833587:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460365.833597:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460365.833622:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460365.833704:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460365.833757:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.834006:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556416 00000100:00100000:2.0:1788460365.834014:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556416 00000100:00100000:2.0:1788460365.834067:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788460365.834075:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482556416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460365.834088:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460365.834102:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec009800/0x889bb893541b7211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b720a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.834158:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009800/0x889bb893541b7211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b720a expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.834169:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec009800/0x889bb893541b7211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b720a expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.835926:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009800, rc 0) 00000100:00100000:3.0:1788460365.836096:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482556416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2018us (2388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460365.836113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788460365.836357:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460365.836382:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.836394:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460365.836446:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.836479:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.836596:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460365.836982:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556544 00000100:00100000:0.0:1788460365.836998:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556544 00000100:00100000:0.0:1788460365.837066:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788460365.837075:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482556544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.837398:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482556544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460365.837406:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788460365.837527:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.837553:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.837581:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.837603:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460365.837631:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556672 00000100:00100000:0.0:1788460365.837634:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556672 00000100:00100000:0.0:1788460365.837654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788460365.837660:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482556672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.837848:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482556672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460365.837853:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788460365.838050:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482556672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.838410:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8496:1875336482556800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460365.838446:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.838511:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460365.838542:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556800 00000100:00100000:3.0:1788460365.838548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556800 00000100:00100000:3.0:1788460365.838588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788460365.838595:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:8496:x1875336482556800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460365.838797:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:8496:x1875336482556800:12345-0@lo:502:llog_process_th.0 Request processed in 201us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460365.838804:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788460365.838859:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8496:1875336482556800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460365.838879:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460365.838886:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460365.838889:0:8496:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788460365.838894:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788460365.838912:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8496:1875336482556928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460365.838943:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460365.838975:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650efcd7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788460365.839020:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482556928 00000100:00100000:0.0:1788460365.839025:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482556928 00000100:00100000:0.0:1788460365.839083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788460365.839089:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:8496:x1875336482556928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460365.839200:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:8496:x1875336482556928:12345-0@lo:502:llog_process_th.0 Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460365.839207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788460365.839218:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8496:1875336482556928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460365.839234:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460365.839238:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460365.839240:0:8496:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788460365.839243:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788460365.839455:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788460365.839466:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788460365.839474:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.839481:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460365.839488:0:5839:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788460365.839490:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650c5118800 from 1 10000000:01000000:0.0:1788460365.839492:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788460365.839509:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.839514:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.839520:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460365.839529:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482557056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.839548:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.839570:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.839579:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557056 00000100:00100000:2.0:1788460365.839583:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557056 00000100:00100000:2.0:1788460365.839613:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788460365.839619:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482557056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460365.839626:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460365.839637:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec009600/0x889bb893541b721f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7218 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.839656:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009600/0x889bb893541b721f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7218 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.839665:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec009600/0x889bb893541b721f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7218 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460365.839672:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009600, rc 0) 00000100:00100000:2.0:1788460365.839716:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482557056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460365.839723:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788460365.839763:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482557056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460365.839775:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.839784:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460365.839806:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482557184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460365.839828:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460365.839843:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460365.839855:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557184 00000100:00100000:2.0:1788460365.839859:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557184 00000100:00100000:2.0:1788460365.839911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788460365.839918:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482557184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460365.840160:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482557184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (329us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460365.840168:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788460365.840220:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482557184:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788460365.840233:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788460365.840239:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460365.840246:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460366.222433:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460366.571696:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460366.571743:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460366.573540:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460366.573570:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460366.573607:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462602752 00000100:00100000:3.0:1788460366.573617:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462602752 00000100:00100000:3.0:1788460366.573670:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462602880 00000100:00100000:3.0:1788460366.573673:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462602880 00000100:00100000:3.0:1788460366.573690:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1788460366.573698:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462602752:12345-192.168.203.32@tcp:400: 00000100:00100000:3.0:1788460366.573774:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462602752:12345-192.168.203.32@tcp:400: Request processed in 76us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460366.573782:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1788460366.573808:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1788460366.573814:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462602880:12345-192.168.203.32@tcp:400: 00000100:00100000:3.0:1788460366.573838:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462602880:12345-192.168.203.32@tcp:400: Request processed in 24us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460366.573844:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1788460366.574025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462602496 00000100:00100000:2.0:1788460366.574030:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462602496 00000100:00100000:2.0:1788460366.574060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 184 00000100:00100000:2.0:1788460366.574067:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:2382:x1875336462602496:12345-192.168.203.32@tcp:400: 00000100:00100000:1.0:1788460366.574082:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462602624 00000100:00100000:1.0:1788460366.574086:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462602624 00000100:00100000:2.0:1788460366.574093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:2382:x1875336462602496:12345-192.168.203.32@tcp:400: Request processed in 28us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460366.574098:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 184 00000100:00100000:1.0:1788460366.574118:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1788460366.574124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462602624:12345-192.168.203.32@tcp:400: 00000100:00080000:2.0:1788460366.574149:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460366.574154:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460366.574156:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460366.574165:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462602624:12345-192.168.203.32@tcp:400: Request processed in 30us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460366.574171:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00010000:00010000:1.0:1788460367.244507:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460368.112630:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460368.112822:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603008 00000100:00100000:1.0:1788460368.112832:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603008 00000100:00100000:1.0:1788460368.112896:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:1.0:1788460368.112908:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:5622:x1875336462603008:12345-192.168.203.32@tcp:101: 00010000:00010000:1.0:1788460368.112922:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460368.112939:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166fe00/0x889bb893541b7226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d11bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460368.112967:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166fe00/0x889bb893541b7226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11bb expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460368.113003:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166fe00/0x889bb893541b7226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11bb expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460368.113013:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166fe00, rc 0) 00000100:00100000:1.0:1788460368.113082:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5622:x1875336462603008:12345-192.168.203.32@tcp:101: Request processed in 177us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460368.113089:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:3.0:1788460368.116915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460368.117443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603136 00000100:00100000:2.0:1788460368.117453:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603136 00000100:00100000:2.0:1788460368.117509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 186 00000100:00100000:2.0:1788460368.117519:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5622:x1875336462603136:12345-192.168.203.32@tcp:501: 00000100:00100000:2.0:1788460368.117799:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5622:x1875336462603136:12345-192.168.203.32@tcp:501: Request processed in 280us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460368.117808:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 186 00000100:00100000:3.0:1788460368.123379:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460368.123522:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603264 00000100:00100000:2.0:1788460368.123532:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603264 00000100:00100000:2.0:1788460368.123587:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:2.0:1788460368.123596:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5622:x1875336462603264:12345-192.168.203.32@tcp:503: 00000100:00100000:2.0:1788460368.123809:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5622:x1875336462603264:12345-192.168.203.32@tcp:503: Request processed in 213us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460368.123817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:3.0:1788460368.138558:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460368.145377:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603392 00000100:00100000:2.0:1788460368.145392:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603392 00000100:00100000:2.0:1788460368.145637:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:2.0:1788460368.145650:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:6112:x1875336462603392:12345-192.168.203.32@tcp:502: 00000100:00100000:2.0:1788460368.145936:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:6112:x1875336462603392:12345-192.168.203.32@tcp:502: Request processed in 288us (7387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460368.145945:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:3.0:1788460368.158519:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460368.158838:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603520 00000100:00100000:2.0:1788460368.158858:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603520 00000100:00100000:2.0:1788460368.158917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:2.0:1788460368.158927:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:6112:x1875336462603520:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460368.159259:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:6112:x1875336462603520:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 332us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460368.159267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:3.0:1788460368.162105:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460368.162549:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603648 00000100:00100000:2.0:1788460368.162558:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603648 00000100:00100000:2.0:1788460368.162611:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:2.0:1788460368.162620:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5622:x1875336462603648:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460368.162635:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460368.162664:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008800/0x889bb893541b722d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d11c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460368.162700:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008800/0x889bb893541b722d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c2 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460368.162712:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008800/0x889bb893541b722d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c2 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460368.162720:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008800, rc 0) 00000100:00100000:2.0:1788460368.162769:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462603648:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 151us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460368.162776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:3.0:1788460368.164431:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460368.164582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603776 00000100:00100000:1.0:1788460368.164592:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603776 00000100:00100000:1.0:1788460368.164641:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:1.0:1788460368.164650:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462603776:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460368.164934:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462603776:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 284us (509us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460368.164943:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 191 00010000:00010000:0.0:1788460368.269122:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460369.292388:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460369.420807:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482557312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460369.420871:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.420914:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482557824:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.420949:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.420986:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788460369.420992:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482557696:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421017:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.421047:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482558208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460369.421076:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.421101:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482557568:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421134:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.421154:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482558080:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421213:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.421234:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788460369.421240:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482557440:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421268:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.421288:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482557952:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421307:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.421335:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557696 00000100:00100000:1.0:1788460369.421342:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557696 00000100:00100000:1.0:1788460369.421385:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557568 00000100:00100000:1.0:1788460369.421388:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557568 00000100:00100000:1.0:1788460369.421399:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557952 00000100:00100000:1.0:1788460369.421401:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557952 00000100:00100000:1.0:1788460369.421416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788460369.421423:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482557696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421471:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482557696:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.421477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788460369.421507:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788460369.421513:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482557568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421542:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482557568:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.421547:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788460369.421558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788460369.421563:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482557952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421598:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482557952:12345-0@lo:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.421604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788460369.421621:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557312 00000100:00100000:1.0:1788460369.421624:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557312 00000100:00100000:1.0:1788460369.421641:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482558208 00000100:00100000:1.0:1788460369.421643:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482558208 00000100:00100000:1.0:1788460369.421654:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460369.421659:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482557312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460369.421684:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460369.421709:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482557312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.421715:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460369.421725:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460369.421730:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482558208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460369.421746:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460369.421769:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482558208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.421774:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788460369.421795:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460369.421799:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460369.421801:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460369.421829:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482557952:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421839:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482557568:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.421867:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482557696:0@lo:400:kworker.0 00010000:00080000:1.0:1788460369.421877:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3d1c00 x1875336482558208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460369.421899:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482558208:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788460369.421912:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb96a00 x1875336482557312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460369.421922:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482557312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460369.422043:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557440 00000100:00100000:0.0:1788460369.422047:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557440 00000100:00100000:0.0:1788460369.422072:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788460369.422079:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482557440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460369.422112:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482557440:12345-0@lo:400:kworker.0 Request processed in 34us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460369.422118:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788460369.422207:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482557824 00000100:00100000:3.0:1788460369.422211:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482557824 00000100:00100000:3.0:1788460369.422235:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482558080 00000100:00100000:3.0:1788460369.422238:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482558080 00000100:00100000:3.0:1788460369.422250:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460369.422256:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482557824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460369.422294:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482557824:12345-0@lo:400:kworker.0 Request processed in 39us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460369.422300:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460369.422312:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788460369.422317:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482558080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460369.422342:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482558080:12345-0@lo:400:kworker.0 Request processed in 25us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460369.422348:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788460369.422375:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3d2300 x1875336482557824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460369.422384:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482557824:0@lo:400:kworker.0 00000100:00100000:1.0:1788460369.422878:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482557440:0@lo:400:kworker.0 00010000:00080000:1.0:1788460369.422890:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3d1180 x1875336482558080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460369.422899:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482558080:0@lo:400:kworker.0 00000020:00000080:0.0:1788460369.965015:0:8536:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee9a2ea60 20000000:00000080:0.0:1788460369.965031:0:8536:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9650ec235c00 uarg=0000000000000000 20000000:01000000:0.0:1788460369.965067:0:8536:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788460369.965072:0:8536:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788460369.965076:0:8536:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788460369.965951:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788460369.966126:0:8536:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788460369.977902:0:8536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788460369.977969:0:8536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788460369.978027:0:8536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788460369.978045:0:8536:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788460369.978064:0:8536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978081:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166f400/0x889bb893541b6f9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b6f94 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978089:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7019 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978095:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7089 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978119:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978126:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978164:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978223:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 9 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460369.978238:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558336:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460369.978352:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7089 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978359:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7089 expref: 22 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460369.978368:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558464:0@lo:104: 00000100:00100000:2.0:1788460369.978406:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460369.978439:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7019 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978447:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7019 expref: 22 pid: 5837 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460369.978454:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558592:0@lo:104: 00000100:00100000:2.0:1788460369.978487:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460369.978516:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166f400/0x889bb893541b6f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b6f94 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460369.978523:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166f400/0x889bb893541b6f9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b6f94 expref: 22 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460369.978531:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0260700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558720:0@lo:104: 00000100:00100000:2.0:1788460369.978554:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460369.978565:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea52a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460369.978991:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482558464 00000100:00100000:1.0:1788460369.978999:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482558464 00000100:00100000:1.0:1788460369.979037:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482558592 00000100:00100000:1.0:1788460369.979041:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482558592 00000100:00100000:1.0:1788460369.979051:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482558720 00000100:00100000:1.0:1788460369.979054:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482558720 00000100:00100000:1.0:1788460369.979066:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788460369.979074:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8536:x1875336482558464:12345-0@lo:104: 00010000:00010000:1.0:1788460369.979087:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979154:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788460369.979161:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:8536:x1875336482558464:12345-0@lo:104: Request processed in 88us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.979168:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788460369.979214:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460369.979221:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:8536:x1875336482558592:12345-0@lo:104: 00010000:00010000:1.0:1788460369.979238:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979275:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788460369.979280:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:8536:x1875336482558592:12345-0@lo:104: Request processed in 60us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.979288:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460369.979301:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460369.979307:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8536:x1875336482558720:12345-0@lo:104: 00010000:00010000:1.0:1788460369.979314:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979341:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788460369.979346:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:8536:x1875336482558720:12345-0@lo:104: Request processed in 40us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.979352:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788460369.979365:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788460369.979370:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979376:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030a00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460369.979380:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979388:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460369.979395:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460369.979407:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460369.979434:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979441:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460369.979459:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979465:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0030a00/0x889bb893541b7089 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7090 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979478:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460369.979481:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979486:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460369.979489:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979496:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460369.979503:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460369.979508:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460369.979519:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979524:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460369.979545:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979553:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4e00/0x889bb893541b7019 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7020 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979561:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460369.979564:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979570:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460369.979573:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979578:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460369.979585:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460369.979589:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460369.979601:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979606:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460369.979612:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979618:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f5600/0x889bb893541b6f94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b6f9b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.979629:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460369.979636:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460369.979637:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460369.979645:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460369.979655:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482558848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460369.979689:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.979725:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482558976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460369.979745:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.979763:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460369.979768:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482559104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460369.979787:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460369.979814:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482558848 00000100:00100000:1.0:1788460369.979818:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482558848 00010000:00010000:1.0:1788460369.979837:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7089 expref: 23 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460369.979926:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482558976 00000100:00100000:1.0:1788460369.979930:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482558976 00010000:00010000:1.0:1788460369.979943:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7019 expref: 24 pid: 5837 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460369.979952:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482559104 00000100:00100000:1.0:1788460369.979954:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482559104 00010000:00010000:1.0:1788460369.979972:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166f400/0x889bb893541b6f9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f94 expref: 25 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460369.979984:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460369.979990:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ea550850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+25:3317:x1875336482558848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460369.979999:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460369.980004:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7089 expref: 25 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.980019:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7089 expref: 25 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.980033:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460369.980061:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ea550850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+25:3317:x1875336482558848:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.980067:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460369.980101:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788460369.980107:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+24:3318:x1875336482558976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460369.980113:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460369.980118:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7019 expref: 24 pid: 5837 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.980126:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7019 expref: 24 pid: 5837 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.980135:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460369.980161:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+24:3318:x1875336482558976:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.980167:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788460369.980200:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788460369.980206:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482559104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460369.980213:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460369.980217:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166f400/0x889bb893541b6f9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b6f94 expref: 23 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.980224:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166f400/0x889bb893541b6f9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b6f94 expref: 23 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460369.980240:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460369.980264:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482559104:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460369.980270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788460369.980311:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482558848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460369.980332:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482559104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460369.980338:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482558976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460369.980513:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460369.981359:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166e600/0x889bb893541b7090 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7089 expref: 22 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460369.981373:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558464:0@lo:104: 00010000:00010000:1.0:1788460369.981384:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5400/0x889bb893541b7020 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7019 expref: 21 pid: 5837 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460369.981392:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558592:0@lo:104: 00010000:00010000:1.0:1788460369.981400:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166f400/0x889bb893541b6f9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b6f94 expref: 20 pid: 5834 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460369.981408:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0260700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558720:0@lo:104: 00000100:00100000:3.0:1788460369.991793:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460369.992486:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462603904 00000100:00100000:0.0:1788460369.992499:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462603904 00010000:00010000:0.0:1788460369.992540:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 10 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460369.992606:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:0.0:1788460369.992615:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2379:x1875336462603904:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460369.992630:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460369.992636:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 10 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992648:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 10 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992669:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992677:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992694:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992700:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992706:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992711:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992717:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460369.992720:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992734:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992743:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460369.992752:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460369.992812:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2379:x1875336462603904:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 197us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460369.992820:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00010000:00010000:1.0:1788460370.001774:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4c00/0x889bb893541b7177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d118a expref: 9 pid: 5834 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460370.001799:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8536:1875336482558336:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460370.001839:0:8536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460370.001872:0:8536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460370.001879:0:8536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460370.001885:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009200/0x889bb893541b7234 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460370.316483:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460371.343258:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460371.689041:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460371.689085:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460371.689131:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460371.689168:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460371.689220:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604416 00000100:00100000:3.0:1788460371.689229:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604416 00000100:00100000:3.0:1788460371.689290:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604288 00000100:00100000:3.0:1788460371.689293:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604288 00000100:00100000:3.0:1788460371.689317:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460371.689326:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462604416:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460371.689393:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462604416:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460371.689402:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460371.689436:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1788460371.689446:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462604288:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460371.689475:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462604288:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460371.689481:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1788460371.689668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604032 00000100:00100000:2.0:1788460371.689672:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604032 00000100:00100000:2.0:1788460371.689709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 193 00000100:00100000:2.0:1788460371.689717:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:2380:x1875336462604032:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460371.689750:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:2380:x1875336462604032:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 35us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460371.689757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 193 00000100:00100000:1.0:1788460371.689907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604160 00000100:00100000:1.0:1788460371.689912:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604160 00000100:00100000:1.0:1788460371.689966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1788460371.689974:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462604160:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460371.690012:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462604160:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 39us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460371.690019:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00080000:1.0:1788460371.690036:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460371.690040:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460371.690042:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460371.822333:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460371.822485:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604544 00000100:00100000:0.0:1788460371.822495:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604544 00000100:00100000:0.0:1788460371.822648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:0.0:1788460371.822660:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:5622:x1875336462604544:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460371.822677:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460371.822695:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d11c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460371.822723:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460371.822734:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460371.822742:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167e00, rc 0) 00000100:00100000:0.0:1788460371.822805:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462604544:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 148us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460371.822836:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:3.0:1788460371.827119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460371.827223:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604672 00000100:00100000:0.0:1788460371.827234:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604672 00000100:00100000:0.0:1788460371.827279:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:0.0:1788460371.827288:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462604672:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460371.827547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462604672:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 259us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460371.827559:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:0.0:1788460371.830028:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460371.830108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604800 00000100:00100000:3.0:1788460371.830117:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604800 00000100:00100000:3.0:1788460371.830166:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:3.0:1788460371.830220:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462604800:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460371.830450:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:5622:x1875336462604800:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 275us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460371.830458:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:0.0:1788460371.847606:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460371.847901:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462604928 00000100:00100000:3.0:1788460371.847911:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462604928 00000100:00100000:3.0:1788460371.847986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:3.0:1788460371.847995:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:6176:x1875336462604928:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460371.848255:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:6176:x1875336462604928:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 260us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460371.848264:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:3.0:1788460371.855636:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460371.857003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605056 00000100:00100000:0.0:1788460371.857016:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605056 00000100:00100000:0.0:1788460371.857083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:0.0:1788460371.857093:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:6176:x1875336462605056:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788460371.857339:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:6176:x1875336462605056:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 247us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460371.857349:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 198 10000000:01000000:2.0:1788460371.982161:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460371.982167:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650efb15800 from 4 10000000:01000000:2.0:1788460371.982171:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460371.982317:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460371.982328:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460371.982338:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460371.982427:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460371.982485:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460371.982558:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460371.989582:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482559232 00000100:00100000:1.0:1788460371.989598:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482559232 00000100:00100000:1.0:1788460371.989666:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788460371.989677:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482559232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460371.989698:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460371.989717:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7242 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460371.989747:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7242 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460371.989771:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7242 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460371.989781:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166ea00, rc 0) 00000100:00100000:1.0:1788460371.989932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (7444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460371.989939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788460371.991975:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460371.992000:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460371.992012:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460371.992731:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788460371.995641:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460371.995905:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788460371.995972:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 112 off8528 00000040:00080000:2.0:1788460371.996030:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 224 off8752 00000040:00080000:2.0:1788460371.997568:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788460371.997663:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460371.997727:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460371.997878:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460371.997983:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482559360 00000100:00100000:0.0:1788460371.997991:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482559360 00000100:00100000:0.0:1788460371.998145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788460371.998155:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460372.003896:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5733us (6159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460372.003908:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788460372.006257:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.006314:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.006375:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.006428:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460372.007118:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482559488 00000100:00100000:3.0:1788460372.007127:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482559488 00000100:00100000:3.0:1788460372.007206:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788460372.007217:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460372.007424:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460372.007431:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788460372.007462:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788460372.008347:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460372.008441:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559616:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.008494:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.010621:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460372.013314:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482559616 00000100:00100000:3.0:1788460372.013328:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482559616 00000100:00100000:3.0:1788460372.013383:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788460372.013402:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559616:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460372.013761:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559616:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 359us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460372.013769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788460372.017096:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559616:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460372.017406:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788460372.017465:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788460372.017516:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788460372.017553:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788460372.017589:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000100:00100000:1.0:1788460372.017633:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559744:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460372.017705:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460372.017741:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d0a98180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460372.017927:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482559744 00000100:00100000:3.0:1788460372.017934:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482559744 00000100:00100000:3.0:1788460372.018051:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788460372.018059:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559744:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460372.018272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559744:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 213us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460372.018289:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788460372.018451:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559744:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460372.018550:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788460372.018561:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:2.0:1788460372.019406:0:8640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460372.019415:0:8640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460372.019418:0:8640:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788460372.019424:0:8640:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650efb15800 00000020:00000080:2.0:1788460372.019426:0:8640:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788460372.019486:0:8640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460372.019489:0:8640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460372.019491:0:8640:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788460372.019493:0:8640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000020:01000000:1.0:1788460372.019599:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788460372.019609:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460372.019618:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460372.019630:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460372.019645:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460372.019647:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650f6139800 from 4 10000000:01000000:1.0:1788460372.019649:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460372.019687:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460372.019696:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460372.019705:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460372.019722:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460372.019768:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460372.019802:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d0a98180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.024600:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482559872 00000100:00100000:2.0:1788460372.024614:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482559872 00000100:00100000:2.0:1788460372.024674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788460372.024685:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482559872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460372.024702:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460372.024719:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b7250 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.024746:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b7250 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.024758:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7250 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.024768:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008200, rc 0) 00000100:00100000:2.0:1788460372.024848:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482559872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (5079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.024855:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788460372.024908:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482559872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460372.024937:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.024957:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460372.025488:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788460372.026296:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460372.026516:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788460372.026562:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788460372.026628:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788460372.026637:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788460372.026707:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.026761:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.026805:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.026829:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560000 00000100:00100000:2.0:1788460372.026834:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560000 00000100:00100000:2.0:1788460372.026868:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788460372.026876:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.027052:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.027060:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788460372.027101:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.027139:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.027175:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.027212:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.027224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560128 00000100:00100000:2.0:1788460372.027227:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560128 00000100:00100000:2.0:1788460372.027247:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788460372.027253:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.027387:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.027394:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788460372.027431:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788460372.027793:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460372.027842:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560256:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.027876:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.027893:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.027907:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560256 00000100:00100000:2.0:1788460372.027910:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560256 00000100:00100000:2.0:1788460372.027932:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788460372.027938:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560256:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.039073:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560256:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 11125us (11187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.039088:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788460372.039301:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560256:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460372.039624:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788460372.039695:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788460372.039746:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788460372.039786:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788460372.039822:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:2.0:1788460372.039859:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560384:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.040096:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.040148:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.040560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560384 00000100:00100000:2.0:1788460372.040568:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560384 00000100:00100000:2.0:1788460372.040608:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788460372.040617:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560384:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.040810:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560384:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 193us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.040817:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788460372.040875:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560384:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460372.044209:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788460372.044231:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788460372.046543:0:8644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460372.046556:0:8644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460372.046559:0:8644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788460372.046566:0:8644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650f6139800 00000020:00000080:0.0:1788460372.046569:0:8644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460372.046643:0:8644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460372.046648:0:8644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460372.046650:0:8644:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788460372.046653:0:8644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:2.0:1788460372.049137:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788460372.049159:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460372.049171:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.052703:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460372.052718:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460372.052720:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5118800 from 4 10000000:01000000:2.0:1788460372.052723:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460372.052762:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.052779:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.052790:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460372.052812:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.052873:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.053289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560512 00000100:00100000:2.0:1788460372.053297:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560512 00000100:00100000:2.0:1788460372.053345:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788460372.053364:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482560512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460372.053378:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460372.053391:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b725e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.053413:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b725e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.053423:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b725e expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.053430:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008a00, rc 0) 00000100:00100000:2.0:1788460372.053468:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482560512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.053474:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788460372.053514:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.053537:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460372.053551:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.053559:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460372.053591:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.053614:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.053634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560640 00000100:00100000:2.0:1788460372.053637:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560640 00000100:00100000:2.0:1788460372.053656:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788460372.053662:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482560640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.053888:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482560640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.053895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788460372.055639:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.055671:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.055721:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.055782:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.055814:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560768 00000100:00100000:2.0:1788460372.055820:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560768 00000100:00100000:2.0:1788460372.055857:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788460372.055866:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482560768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.057479:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482560768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1608us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.057503:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788460372.057560:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.057582:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482560768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460372.057808:0:8645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8645:1875336482560896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460372.057850:0:8645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.057878:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482560896 00000100:00100000:2.0:1788460372.057883:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482560896 00000100:00100000:2.0:1788460372.057912:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788460372.057935:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:8645:x1875336482560896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460372.058081:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:8645:x1875336482560896:12345-0@lo:502:llog_process_th.0 Request processed in 148us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.058088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788460372.058117:0:8645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.058130:0:8645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8645:1875336482560896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460372.058151:0:8645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460372.058160:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460372.058162:0:8645:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788460372.058169:0:8645:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650c5118800 00000020:00000080:2.0:1788460372.058171:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788460372.058263:0:8645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8645:1875336482561024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460372.058295:0:8645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460372.058315:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561024 00000100:00100000:2.0:1788460372.058319:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561024 00000100:00100000:2.0:1788460372.058339:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788460372.058346:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:8645:x1875336482561024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460372.058456:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:8645:x1875336482561024:12345-0@lo:502:llog_process_th.0 Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460372.058463:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788460372.058491:0:8645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d3053480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460372.058503:0:8645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:8645:1875336482561024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460372.058521:0:8645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460372.058525:0:8645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460372.058527:0:8645:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788460372.058530:0:8645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788460372.058575:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788460372.058582:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460372.058592:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460372.058602:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460372.365803:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460373.388432:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460374.418891:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460374.541509:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482561152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460374.541582:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460374.541670:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561152 00000100:00100000:1.0:1788460374.541677:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561152 00000100:00100000:1.0:1788460374.541727:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460374.541748:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482561152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460374.541781:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460374.541819:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482561152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460374.541826:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788460374.541847:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460374.541870:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108ed80 x1875336482561152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460374.541889:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482561152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460374.542864:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482561408:0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.542927:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460374.542969:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460374.542975:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482561536:0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.542997:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460374.543027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561408 00000100:00100000:3.0:1788460374.543032:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561408 00000100:00100000:3.0:1788460374.543063:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561536 00000100:00100000:3.0:1788460374.543066:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561536 00000100:00100000:3.0:1788460374.543092:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460374.543099:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482561408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543152:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482561408:12345-0@lo:400:kworker.0 Request processed in 53us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460374.543159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460374.543171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788460374.543192:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482561536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543215:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482561536:12345-0@lo:400:kworker.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460374.543220:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788460374.543244:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482561280:0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543269:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460374.543497:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482561792:0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543523:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460374.543542:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460374.543557:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482561664:0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543579:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460374.543601:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561792 00000100:00100000:3.0:1788460374.543605:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561792 00000100:00100000:3.0:1788460374.543631:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788460374.543637:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482561792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543668:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482561792:12345-0@lo:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460374.543674:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788460374.543692:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460374.543695:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460374.543717:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482561536:0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543728:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482561408:0@lo:400:kworker.0 00010000:00080000:3.0:1788460374.543823:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fcd3dc00 x1875336482561792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460374.543833:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482561792:0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543847:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561664 00000100:00100000:3.0:1788460374.543850:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561664 00000100:00100000:3.0:1788460374.543873:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788460374.543878:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482561664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460374.543909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482561664:12345-0@lo:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460374.543915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788460374.543941:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460374.543956:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482561664:0@lo:400:kworker.0 00000100:00100000:2.0:1788460374.544098:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561280 00000100:00100000:2.0:1788460374.544113:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561280 00000100:00100000:2.0:1788460374.544138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788460374.544144:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482561280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460374.544205:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482561280:12345-0@lo:400:kworker.0 Request processed in 34us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460374.544211:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788460374.544606:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788460374.544618:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482561920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460374.544649:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460374.544700:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482561280:0@lo:400:kworker.0 00000100:00100000:2.0:1788460374.544942:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482561920 00000100:00100000:2.0:1788460374.544946:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482561920 00000100:00100000:2.0:1788460374.544981:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460374.544997:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482561920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460374.545023:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460374.545071:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482561920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460374.545077:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788460374.545219:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0262a00 x1875336482561920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460374.545243:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482561920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788460375.436374:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460376.290901:0:8840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788460376.465632:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460376.809046:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460376.809087:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460376.809130:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460376.809156:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460376.809201:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605184 00000100:00100000:2.0:1788460376.809211:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605184 00000100:00100000:2.0:1788460376.809258:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:2.0:1788460376.809267:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2380:x1875336462605184:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460376.809332:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2380:x1875336462605184:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460376.809340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:1.0:1788460376.809380:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605568 00000100:00100000:1.0:1788460376.809388:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605568 00000100:00100000:2.0:1788460376.809389:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605440 00000100:00100000:2.0:1788460376.809394:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605440 00000100:00100000:2.0:1788460376.809434:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1788460376.809476:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605312 00000100:00100000:3.0:1788460376.809481:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605312 00000100:00100000:3.0:1788460376.809514:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1788460376.809521:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462605312:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460376.809801:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462605312:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 269us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460376.809808:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00080000:3.0:1788460376.809952:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460376.809956:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460376.809959:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460376.810299:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462605440:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460376.810354:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462605440:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 914us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460376.813893:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788460376.813910:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788460376.814033:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1788460376.814048:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462605568:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460376.814125:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462605568:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 82us (5036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460376.814133:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1788460376.818296:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00010000:00010000:1.0:1788460377.490079:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460378.512531:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460379.541174:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460379.660343:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482562048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460379.660407:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460379.660484:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562048 00000100:00100000:1.0:1788460379.660492:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562048 00000100:00100000:1.0:1788460379.660544:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460379.660554:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482562048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460379.660587:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460379.660627:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482562048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460379.660634:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788460379.660657:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460379.660697:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108ed80 x1875336482562048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460379.660716:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482562048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460379.661019:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482562176:0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661051:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460379.661072:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482562688:0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661093:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460379.661111:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460379.661116:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482562304:0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661137:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460379.661165:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562688 00000100:00100000:1.0:1788460379.661169:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562688 00000100:00100000:1.0:1788460379.661219:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460379.661226:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482562688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661260:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482562688:12345-0@lo:400:kworker.0 Request processed in 36us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460379.661267:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460379.661285:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562304 00000100:00100000:1.0:1788460379.661289:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562304 00000100:00100000:1.0:1788460379.661314:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788460379.661320:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482562304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661350:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482562304:12345-0@lo:400:kworker.0 Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460379.661356:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788460379.661379:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482562432:0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661409:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460379.661426:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460379.661430:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482562560:0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661448:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460379.661467:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562432 00000100:00100000:1.0:1788460379.661471:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562432 00000100:00100000:1.0:1788460379.661489:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562560 00000100:00100000:1.0:1788460379.661492:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562560 00000100:00100000:1.0:1788460379.661506:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788460379.661512:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482562432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661540:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482562432:12345-0@lo:400:kworker.0 Request processed in 28us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460379.661546:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788460379.661557:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460379.661562:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482562560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661583:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482562560:12345-0@lo:400:kworker.0 Request processed in 21us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460379.661588:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788460379.661605:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460379.661608:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460379.661627:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482562560:0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661635:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482562432:0@lo:400:kworker.0 00000100:00100000:1.0:1788460379.661656:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482562304:0@lo:400:kworker.0 00010000:00080000:1.0:1788460379.661666:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108f480 x1875336482562688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460379.661687:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482562688:0@lo:400:kworker.0 00000100:00100000:2.0:1788460379.663935:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562176 00000100:00100000:2.0:1788460379.663953:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562176 00000100:00100000:2.0:1788460379.664001:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788460379.664023:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482562176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460379.664104:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482562176:12345-0@lo:400:kworker.0 Request processed in 83us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460379.664111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788460379.664169:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482562176:0@lo:400:kworker.0 00000100:00100000:2.0:1788460379.664219:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460379.664229:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482562816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460379.664259:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460379.664295:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562816 00000100:00100000:2.0:1788460379.664299:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562816 00000100:00100000:2.0:1788460379.664324:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788460379.664332:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482562816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460379.664359:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460379.664395:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482562816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460379.664401:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788460379.664431:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831c000 x1875336482562816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460379.664448:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482562816:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788460380.560256:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788460381.117149:0:9087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing yml_node 00010000:00010000:1.0:1788460381.580324:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460381.937962:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460381.938024:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460381.938081:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605824 00000100:00100000:2.0:1788460381.938091:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605824 00000100:00100000:2.0:1788460381.938164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:2.0:1788460381.938206:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462605824:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460381.938297:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462605824:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460381.938308:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00080000:2.0:1788460381.938337:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460381.938815:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605696 00000100:00100000:3.0:1788460381.938821:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605696 00000100:00100000:3.0:1788460381.938869:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:3.0:1788460381.938888:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462605696:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460381.938932:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462605696:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 55us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460381.938941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:3.0:1788460381.945475:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460381.945511:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460381.945633:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462605952 00000100:00100000:3.0:1788460381.945644:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462605952 00000100:00100000:3.0:1788460381.945722:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606080 00000100:00100000:3.0:1788460381.945726:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606080 00000100:00100000:3.0:1788460381.945753:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1788460381.945763:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2378:x1875336462605952:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:3.0:1788460381.945795:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7185 00000100:00080000:3.0:1788460381.945805:0:6701:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460381.945841:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788460381.945917:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1788460381.945929:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2378:x1875336462606080:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:0.0:1788460381.945951:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b718c 00000100:00080000:0.0:1788460381.945960:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9650f5cf8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460381.945989:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788460381.946285:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+2:2378:x1875336462606080:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 358us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460381.946294:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00010000:00010000:0.0:1788460381.946347:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460381.946510:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+2:2378:x1875336462605952:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 748us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460381.946518:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00080000:1.0:1788460381.946615:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460381.946620:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460381.947370:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460382.605742:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460383.630080:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460384.654307:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460384.780739:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482562944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460384.780812:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460384.780953:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482562944 00000100:00100000:0.0:1788460384.780961:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482562944 00000100:00100000:0.0:1788460384.781023:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460384.781033:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482562944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460384.781074:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460384.781121:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482562944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460384.781144:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788460384.781210:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831dc00 x1875336482562944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460384.781229:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482562944:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788460384.781502:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460384.781844:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460384.781855:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482563072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460384.781903:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460384.781940:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563072 00000100:00100000:2.0:1788460384.781945:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563072 00000100:00100000:2.0:1788460384.781980:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460384.781988:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482563072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460384.782010:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460384.782043:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482563072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460384.782258:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482563328:0@lo:400:kworker.0 00000100:00100000:0.0:1788460384.782361:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460384.782384:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460384.782391:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482563200:0@lo:400:kworker.0 00000100:00100000:0.0:1788460384.782418:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460384.782448:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563328 00000100:00100000:0.0:1788460384.782453:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563328 00000100:00100000:0.0:1788460384.782482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788460384.782847:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788460384.782881:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460384.782896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563200 00000100:00100000:2.0:1788460384.782899:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563200 00000100:00100000:2.0:1788460384.782933:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788460384.782941:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482563200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460384.782995:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482563200:12345-0@lo:400:kworker.0 Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460384.783001:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788460384.783029:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482563456:0@lo:400:kworker.0 00000100:00100000:0.0:1788460384.783136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482563328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460384.783171:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482563328:12345-0@lo:400:kworker.0 Request processed in 38us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460384.783203:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788460384.783227:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482563584:0@lo:400:kworker.0 00000100:00100000:1.0:1788460384.783392:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482563200:0@lo:400:kworker.0 00000100:00100000:1.0:1788460384.783406:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482563328:0@lo:400:kworker.0 00000100:00100000:2.0:1788460384.784747:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460384.784890:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563456 00000100:00100000:1.0:1788460384.784899:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563456 00000100:00100000:1.0:1788460384.784952:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788460384.784961:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482563456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460384.785016:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482563456:12345-0@lo:400:kworker.0 Request processed in 57us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460384.785022:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788460384.785143:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460384.785366:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563584 00000100:00100000:1.0:1788460384.785371:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563584 00000100:00100000:1.0:1788460384.785394:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788460384.785401:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482563584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460384.785439:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482563584:12345-0@lo:400:kworker.0 Request processed in 39us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460384.785444:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788460384.785563:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460384.785741:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482563456:0@lo:400:kworker.0 00010000:00080000:3.0:1788460384.785757:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d831ca80 x1875336482563072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460384.785776:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482563072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460384.785849:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482563584:0@lo:400:kworker.0 00000001:02000400:3.0:1788460385.019262:0:9280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.7 00010000:00010000:3.0:1788460385.680873:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788460385.874970:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:2.0:1788460385.874980:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650f5cfd000/9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:1.0:1788460385.875074:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5cfd000/9e69358b-6b5d-4a87-b6fb-534c610a3920 for lustre-OST0001 00000020:00000080:1.0:1788460385.875145:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650f5cf8000 for lustre-OST0001 00010000:00010000:2.0:1788460386.700931:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788460386.949723:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:0.0:1788460386.949734:0:6730:0:(genops.c:885:class_export_put()) final put ffff9650f5cfe000/9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:1.0:1788460386.955701:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5cfe000/9e69358b-6b5d-4a87-b6fb-534c610a3920 for lustre-OST0000 00000020:00000080:1.0:1788460386.955754:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650f5cff000 for lustre-OST0000 00000100:00100000:0.0:1788460387.049596:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460387.049644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460387.049739:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606336 00000100:00100000:1.0:1788460387.049750:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606336 00000100:00100000:1.0:1788460387.049823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:1.0:1788460387.049833:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462606336:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460387.049917:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462606336:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460387.049925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00080000:0.0:1788460387.049995:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460387.050065:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606208 00000100:00100000:3.0:1788460387.050070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606208 00000100:00100000:3.0:1788460387.050111:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:3.0:1788460387.050120:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462606208:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460387.050164:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462606208:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 46us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460387.050274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 219 00010000:00010000:1.0:1788460387.725027:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788460387.806702:0:9379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.7 00010000:00010000:2.0:1788460388.749447:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460389.772437:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460389.901381:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482563712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460389.901466:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460389.901611:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563712 00000100:00100000:2.0:1788460389.901620:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563712 00000100:00100000:2.0:1788460389.901688:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460389.901698:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482563712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460389.901731:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460389.901780:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482563712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460389.901787:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788460389.901837:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c75c9880 x1875336482563712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460389.901857:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482563712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788460389.901952:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460389.904358:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460389.904378:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482563840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460389.904440:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460389.904956:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563840 00000100:00100000:2.0:1788460389.904964:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563840 00000100:00100000:2.0:1788460389.905030:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788460389.905039:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482563840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460389.905070:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460389.905122:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482563840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460389.905129:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788460389.905167:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c75c9880 x1875336482563840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460389.905351:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482563840:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788460389.905418:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460389.913107:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482563968:0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913205:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460389.913248:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460389.913253:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482564096:0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913277:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460389.913303:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482564224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913323:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460389.913339:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460389.913343:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482564352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913360:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460389.913385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482563968 00000100:00100000:1.0:1788460389.913391:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482563968 00000100:00100000:1.0:1788460389.913432:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788460389.913439:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482563968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913479:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482563968:12345-0@lo:400:kworker.0 Request processed in 41us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460389.913497:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788460389.913530:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564096 00000100:00100000:1.0:1788460389.913533:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564096 00000100:00100000:1.0:1788460389.913552:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564224 00000100:00100000:1.0:1788460389.913554:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564224 00000100:00100000:1.0:1788460389.913569:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564352 00000100:00100000:1.0:1788460389.913571:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564352 00000100:00100000:1.0:1788460389.913582:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460389.913587:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482564096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913613:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482564096:12345-0@lo:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460389.913618:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460389.913627:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460389.913631:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482564224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913652:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482564224:12345-0@lo:400:kworker.0 Request processed in 20us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460389.913657:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460389.913666:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460389.913671:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482564352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913690:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482564352:12345-0@lo:400:kworker.0 Request processed in 20us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460389.913696:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788460389.913722:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460389.913748:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482564352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913758:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482564224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913795:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482564096:0@lo:400:kworker.0 00000100:00100000:1.0:1788460389.913803:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482563968:0@lo:400:kworker.0 00000001:02000400:0.0:1788460390.431364:0:9477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.7 00010000:00010000:2.0:1788460390.796353:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460391.826000:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788460392.038113:0:9525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 14:33:09 EDT 2026 00000100:00100000:0.0:1788460392.174053:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460392.174103:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460392.174203:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606464 00000100:00100000:1.0:1788460392.174219:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606464 00000100:00100000:1.0:1788460392.174270:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:1.0:1788460392.174279:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2379:x1875336462606464:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460392.174335:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2379:x1875336462606464:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460392.174342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:1.0:1788460392.174371:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606592 00000100:00100000:1.0:1788460392.174374:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606592 00000100:00100000:1.0:1788460392.174406:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1788460392.174413:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462606592:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460392.174441:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462606592:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460392.174448:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00080000:1.0:1788460392.174561:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788460392.844319:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460393.882611:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460394.893695:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460395.020395:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460395.020418:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482564480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460395.020483:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460395.020546:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564480 00000100:00100000:2.0:1788460395.020553:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564480 00000100:00100000:2.0:1788460395.020619:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788460395.020629:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482564480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460395.020663:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460395.020718:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482564480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460395.020725:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788460395.020746:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788460395.020773:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c75c9880 x1875336482564480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460395.020803:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482564480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460395.021782:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460395.021807:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482564608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460395.021851:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460395.021938:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564608 00000100:00100000:3.0:1788460395.021944:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564608 00000100:00100000:3.0:1788460395.021997:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788460395.022005:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482564608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460395.022031:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460395.022074:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482564608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460395.022081:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788460395.022118:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964fc2d7d880 x1875336482564608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460395.022133:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482564608:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788460395.022200:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460395.024866:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482564864:0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.024931:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460395.024966:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460395.024973:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482564736:0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025000:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460395.025038:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564864 00000100:00100000:3.0:1788460395.025046:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564864 00000100:00100000:3.0:1788460395.025092:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460395.025114:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482564864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482564864:12345-0@lo:400:kworker.0 Request processed in 62us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460395.025170:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460395.025227:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564736 00000100:00100000:3.0:1788460395.025231:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564736 00000100:00100000:3.0:1788460395.025256:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788460395.025262:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482564736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482564736:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460395.025300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788460395.025344:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482564736:0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025357:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482564864:0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025381:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482564992:0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025405:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460395.025425:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460395.025431:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482565120:0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025450:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460395.025475:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482564992 00000100:00100000:3.0:1788460395.025479:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482564992 00000100:00100000:3.0:1788460395.025507:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482565120 00000100:00100000:3.0:1788460395.025510:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482565120 00000100:00100000:3.0:1788460395.025528:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460395.025534:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482564992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025567:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482564992:12345-0@lo:400:kworker.0 Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460395.025573:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460395.025721:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460395.025727:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482565120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025758:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482565120:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460395.025772:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788460395.025805:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460395.025826:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482565120:0@lo:400:kworker.0 00000100:00100000:3.0:1788460395.025836:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482564992:0@lo:400:kworker.0 00010000:00010000:0.0:1788460395.926394:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460396.942260:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460397.290938:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460397.290988:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460397.291043:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606848 00000100:00100000:0.0:1788460397.291053:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606848 00000100:00100000:0.0:1788460397.291120:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:0.0:1788460397.291129:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462606848:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460397.291220:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462606848:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460397.291228:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:0.0:1788460397.291250:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606720 00000100:00100000:0.0:1788460397.291254:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606720 00000100:00100000:0.0:1788460397.291279:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:0.0:1788460397.291286:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2381:x1875336462606720:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460397.291312:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2381:x1875336462606720:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460397.291318:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00080000:1.0:1788460397.291495:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460397.964649:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460398.991093:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460400.012918:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460400.141719:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482565248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460400.141797:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460400.141943:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482565248 00000100:00100000:0.0:1788460400.141952:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482565248 00000100:00100000:0.0:1788460400.142012:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788460400.142022:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482565248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460400.142062:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460400.142105:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482565248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460400.142112:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788460400.143141:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788460400.143204:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c4fc0380 x1875336482565248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460400.143245:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482565248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460400.143512:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482565376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460400.143561:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460400.143834:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482565376 00000100:00100000:3.0:1788460400.143841:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482565376 00000100:00100000:3.0:1788460400.143885:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788460400.143893:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482565376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460400.143923:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460400.143961:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482565376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460400.143968:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788460400.144001:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964fc2d7f800 x1875336482565376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460400.144014:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482565376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788460400.144400:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460400.144471:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482565504:0@lo:400:kworker.0 00000100:00100000:2.0:1788460400.144508:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460400.144541:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460400.144548:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482565632:0@lo:400:kworker.0 00000100:00100000:2.0:1788460400.144571:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460400.144599:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482565760:0@lo:400:kworker.0 00000100:00100000:2.0:1788460400.144622:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460400.144641:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460400.144646:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482565888:0@lo:400:kworker.0 00000100:00100000:2.0:1788460400.144666:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460400.144694:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482565504 00000100:00100000:2.0:1788460400.144698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482565504 00000100:00100000:2.0:1788460400.144728:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788460400.144735:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482565504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460400.145410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482565632 00000100:00100000:3.0:1788460400.145416:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482565632 00000100:00100000:3.0:1788460400.145448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482565760 00000100:00100000:3.0:1788460400.145451:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482565760 00000100:00100000:3.0:1788460400.145468:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482565888 00000100:00100000:3.0:1788460400.145472:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482565888 00000100:00100000:3.0:1788460400.145486:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788460400.145506:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482565632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460400.145555:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482565632:12345-0@lo:400:kworker.0 Request processed in 50us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460400.145562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788460400.145578:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788460400.145584:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482565760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460400.145614:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482565760:12345-0@lo:400:kworker.0 Request processed in 31us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460400.145620:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788460400.145631:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460400.145637:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482565888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460400.145662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482565888:12345-0@lo:400:kworker.0 Request processed in 25us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460400.145667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788460400.145697:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460400.145734:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482565632:0@lo:400:kworker.0 00000100:00100000:3.0:1788460400.145784:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482565888:0@lo:400:kworker.0 00000100:00100000:3.0:1788460400.145795:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482565760:0@lo:400:kworker.0 00000100:00100000:3.0:1788460400.147629:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482565504:12345-0@lo:400:kworker.0 Request processed in 2884us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460400.147641:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788460400.147736:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482565504:0@lo:400:kworker.0 00010000:00010000:1.0:1788460401.043880:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460402.060606:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460402.409359:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460402.409398:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460402.409436:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462607104 00000100:00100000:2.0:1788460402.409450:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462607104 00000100:00100000:2.0:1788460402.409509:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1788460402.409518:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462607104:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460402.409587:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462607104:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460402.409594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00080000:3.0:1788460402.411595:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460402.413154:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462606976 00000100:00100000:0.0:1788460402.413199:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462606976 00000100:00100000:0.0:1788460402.413264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:0.0:1788460402.413273:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462606976:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460402.413348:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462606976:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 76us (3996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460402.413356:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 225 00010000:00010000:1.0:1788460403.087159:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460404.108433:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460405.132780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460405.260679:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482566144:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.260777:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460405.260851:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482566656:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.260878:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460405.260913:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788460405.260919:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482566016:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.260945:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460405.260963:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482566528:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.260984:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460405.261010:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482566400:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.261033:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460405.261050:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788460405.261055:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482566272:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.261075:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460405.261094:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482566784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460405.261115:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460405.261142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566144 00000100:00100000:2.0:1788460405.261149:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566144 00000100:00100000:2.0:1788460405.261221:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566528 00000100:00100000:2.0:1788460405.261225:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566528 00000100:00100000:2.0:1788460405.261247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566272 00000100:00100000:2.0:1788460405.261250:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566272 00000100:00100000:2.0:1788460405.261263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460405.261271:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482566144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.261322:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482566144:12345-0@lo:400:kworker.0 Request processed in 50us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460405.261329:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460405.261353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788460405.261361:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482566528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.261391:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482566528:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460405.261396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788460405.261407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460405.261413:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482566272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.261443:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482566272:12345-0@lo:400:kworker.0 Request processed in 30us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460405.261448:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460405.261489:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482566272:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.261520:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482566528:0@lo:400:kworker.0 00000100:00100000:2.0:1788460405.261529:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482566144:0@lo:400:kworker.0 00000100:00100000:1.0:1788460405.261855:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566656 00000100:00100000:1.0:1788460405.261861:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566656 00000100:00100000:1.0:1788460405.261905:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566400 00000100:00100000:1.0:1788460405.261908:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566400 00000100:00100000:1.0:1788460405.261935:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460405.261942:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482566656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460405.261979:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482566656:12345-0@lo:400:kworker.0 Request processed in 38us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460405.261986:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460405.261998:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460405.262004:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482566400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460405.262032:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482566400:12345-0@lo:400:kworker.0 Request processed in 28us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460405.262037:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788460405.262197:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566016 00000100:00100000:3.0:1788460405.262212:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566016 00000100:00100000:3.0:1788460405.262243:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788460405.262251:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482566016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460405.262284:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482566016:12345-0@lo:400:kworker.0 Request processed in 34us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460405.262290:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788460405.262326:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566784 00000100:00100000:3.0:1788460405.262329:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566784 00000100:00100000:3.0:1788460405.262349:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788460405.262354:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482566784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460405.262378:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460405.262404:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482566784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460405.262410:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788460405.262424:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460405.262427:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460405.262429:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460405.262742:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482566912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460405.262773:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460405.262875:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482566016:0@lo:400:kworker.0 00010000:00080000:3.0:1788460405.262889:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb96680 x1875336482566656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460405.262899:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482566656:0@lo:400:kworker.0 00010000:00080000:2.0:1788460405.262970:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c4fc0700 x1875336482566784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460405.262984:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482566784:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788460405.262995:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb96a00 x1875336482566400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460405.263003:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482566400:0@lo:400:kworker.0 00000100:00100000:0.0:1788460405.270547:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482566912 00000100:00100000:0.0:1788460405.270564:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482566912 00000100:00100000:0.0:1788460405.270636:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788460405.270647:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482566912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460405.270704:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460405.270800:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482566912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (8025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460405.270808:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788460405.271016:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c4fc2680 x1875336482566912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460405.271053:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482566912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788460406.157226:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788460407.028557:0:10156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:33:24 (1788460404) === 00010000:00010000:3.0:1788460407.180341:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460407.534488:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.534540:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460407.534722:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462607232 00000100:00100000:0.0:1788460407.534733:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462607232 00000100:00100000:0.0:1788460407.534802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00100000:0.0:1788460407.534813:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2379:x1875336462607232:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460407.534974:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462607360 00000100:00100000:2.0:1788460407.534978:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462607360 00000100:00100000:2.0:1788460407.535021:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:2.0:1788460407.535029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462607360:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460407.535413:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2379:x1875336462607232:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 600us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460407.535421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00080000:0.0:1788460407.535515:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460407.535790:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462607360:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 760us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460407.535798:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1788460407.664607:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.664896:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462607488 00000100:00100000:3.0:1788460407.664920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462607488 00000100:00100000:3.0:1788460407.664985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:3.0:1788460407.664996:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:8171:x1875336462607488:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460407.665014:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460407.665031:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4600/0x889bb893541b726c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d11d0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.665057:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4600/0x889bb893541b726c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11d0 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.665069:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4600/0x889bb893541b726c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11d0 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.665078:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4600, rc 0) 00000100:00100000:3.0:1788460407.665213:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+11:8171:x1875336462607488:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 218us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.665221:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:1.0:1788460407.675233:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.675394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462607616 00000100:00100000:3.0:1788460407.675404:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462607616 00000100:00100000:3.0:1788460407.675460:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:3.0:1788460407.675470:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+11:8171:x1875336462607616:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788460407.676349:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+11:8171:x1875336462607616:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 876us (1122us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460407.676360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:1.0:1788460407.681953:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460407.682048:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462607744 00000100:00100000:0.0:1788460407.682058:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462607744 00000100:00100000:0.0:1788460407.682119:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 230 00000100:00100000:0.0:1788460407.682131:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+11:8171:x1875336462607744:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788460407.682150:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460407.682169:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167800/0x889bb893541b7273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d11d7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460407.682234:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167800/0x889bb893541b7273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11d7 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460407.682247:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167800/0x889bb893541b7273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11d7 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460407.682255:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167800, rc 0) 00000100:00100000:0.0:1788460407.682310:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8171:x1875336462607744:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 181us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460407.682317:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 230 00000100:00100000:0.0:1788460407.684471:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.684553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462607872 00000100:00100000:3.0:1788460407.684562:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462607872 00000100:00100000:3.0:1788460407.684614:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:3.0:1788460407.684624:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8171:x1875336462607872:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788460407.685077:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8171:x1875336462607872:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 453us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.685087:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:1.0:1788460407.691713:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.692440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608000 00000100:00100000:3.0:1788460407.692452:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608000 00000100:00100000:3.0:1788460407.692563:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 232 00000100:00100000:3.0:1788460407.692574:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8171:x1875336462608000:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788460407.692827:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8171:x1875336462608000:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 253us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.692836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 232 00000100:00100000:1.0:1788460407.708838:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.711787:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608128 00000100:00100000:3.0:1788460407.711803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608128 00000100:00100000:3.0:1788460407.711872:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00100000:3.0:1788460407.711883:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8175:x1875336462608128:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460407.714383:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8175:x1875336462608128:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 2491us (5543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.714400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00100000:1.0:1788460407.724515:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.724823:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608256 00000100:00100000:3.0:1788460407.724834:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608256 00000100:00100000:3.0:1788460407.724895:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:3.0:1788460407.724904:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8175:x1875336462608256:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460407.733319:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8175:x1875336462608256:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 8405us (8803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460407.733333:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:1.0:1788460407.737326:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.737408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608384 00000100:00100000:3.0:1788460407.737418:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608384 00000100:00100000:3.0:1788460407.737521:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 235 00000100:00100000:3.0:1788460407.737533:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:8171:x1875336462608384:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460407.737563:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460407.737581:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5200/0x889bb893541b727a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1201 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.737610:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5200/0x889bb893541b727a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1201 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.737622:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5200/0x889bb893541b727a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1201 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.737630:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5200, rc 0) 00000100:00100000:3.0:1788460407.737760:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:8171:x1875336462608384:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 229us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.737767:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 235 00000100:00100000:1.0:1788460407.757753:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460407.757900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608512 00000100:00100000:0.0:1788460407.757913:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608512 00000100:00100000:0.0:1788460407.757976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00100000:0.0:1788460407.757986:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:8171:x1875336462608512:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788460407.758015:0:5834:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788460407.758049:0:5834:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788460407.758054:0:5834:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788460407.758057:0:5834:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788460407.758059:0:5834:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788460407.761787:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:8171:x1875336462608512:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 3792us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460407.761800:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00100000:1.0:1788460407.773082:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.775754:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608640 00000100:00100000:3.0:1788460407.775770:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608640 00000100:00100000:3.0:1788460407.775843:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 237 00000100:00100000:3.0:1788460407.775853:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:8171:x1875336462608640:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460407.775878:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460407.775897:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1208 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.775928:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.775940:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460407.775970:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5a00, rc 0) 00000100:00100000:3.0:1788460407.776052:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8171:x1875336462608640:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 201us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.776059:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 237 00000100:00100000:1.0:1788460407.779071:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460407.779219:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608768 00000100:00100000:0.0:1788460407.779228:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608768 00000100:00100000:0.0:1788460407.779282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00100000:0.0:1788460407.779292:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8171:x1875336462608768:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788460407.779571:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8171:x1875336462608768:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 279us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460407.779579:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00100000:0.0:1788460407.781790:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460407.781892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462608896 00000100:00100000:1.0:1788460407.781902:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462608896 00000100:00100000:1.0:1788460407.781951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00100000:1.0:1788460407.781961:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8171:x1875336462608896:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788460407.782201:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8171:x1875336462608896:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 220us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460407.782220:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00100000:1.0:1788460407.785354:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.785466:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609024 00000100:00100000:3.0:1788460407.785476:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609024 00000100:00100000:3.0:1788460407.785532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 240 00000100:00100000:3.0:1788460407.785542:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8179:x1875336462609024:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460407.785848:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8179:x1875336462609024:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 306us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.785856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 240 00000100:00100000:3.0:1788460407.800959:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460407.801106:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609152 00000100:00100000:0.0:1788460407.801116:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609152 00000100:00100000:0.0:1788460407.801171:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:0.0:1788460407.801315:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8179:x1875336462609152:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460407.807459:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:8179:x1875336462609152:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 6267us (6496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460407.807472:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:0.0:1788460407.810318:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.810672:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609280 00000100:00100000:3.0:1788460407.810681:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609280 00000100:00100000:3.0:1788460407.810732:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1788460407.810740:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2378:x1875336462609280:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788460407.810764:0:5842:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from ece97008-0c90-48dc-9560-3b476895ed7b@192.168.203.32@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788460407.810801:0:5842:0:(genops.c:1385:class_connect()) connect: client ece97008-0c90-48dc-9560-3b476895ed7b, cookie 0x889bb893541b7288 00000004:00100000:3.0:1788460407.810830:0:5842:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788460407.811472:0:5842:0:(import.c:65:import_set_state_nolock()) ffff964fc3da5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460407.811602:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+6:2378:x1875336462609280:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 860us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.811611:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1788460407.830758:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.831092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609408 00000100:00100000:3.0:1788460407.831116:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609408 00000100:00100000:3.0:1788460407.831216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1788460407.831227:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+6:0:x1875336462609408:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788460407.831275:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788460407.831355:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+6:0:x1875336462609408:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 130us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.831362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460407.831498:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00080000:1.0:1788460407.831759:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460407.831812:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609536 00000100:00100000:2.0:1788460407.831817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609536 00000100:00100000:2.0:1788460407.831865:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1788460407.831872:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+6:8171:x1875336462609536:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788460407.831888:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788460407.831927:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+6:8171:x1875336462609536:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 56us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460407.831934:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1788460407.834555:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.834649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609664 00000100:00100000:3.0:1788460407.834657:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609664 00000100:00100000:3.0:1788460407.834716:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1788460407.834726:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+6:8171:x1875336462609664:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788460407.834852:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+6:8171:x1875336462609664:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.834859:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1788460407.836351:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.836428:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609792 00000100:00100000:3.0:1788460407.836435:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609792 00000100:00100000:3.0:1788460407.836471:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1788460407.836478:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2378:x1875336462609792:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788460407.836504:0:6701:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from ece97008-0c90-48dc-9560-3b476895ed7b@192.168.203.32@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788460407.836536:0:6701:0:(genops.c:1385:class_connect()) connect: client ece97008-0c90-48dc-9560-3b476895ed7b, cookie 0x889bb893541b728f 00002000:00100000:3.0:1788460407.836546:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ece97008-0c90-48dc-9560-3b476895ed7b/ffff964fc3da6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460407.836568:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460407.836810:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788460407.836837:0:6701:0:(import.c:65:import_set_state_nolock()) ffff964fc3da7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460407.836953:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ece97008-0c90-48dc-9560-3b476895ed7b+6:2378:x1875336462609792:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 473us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.836972:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460407.837719:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460407.837814:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460407.838210:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610048 00000100:00100000:3.0:1788460407.838218:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610048 00000100:00100000:3.0:1788460407.838275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1788460407.838284:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ece97008-0c90-48dc-9560-3b476895ed7b+6:8171:x1875336462610048:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788460407.838371:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788460407.838456:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ece97008-0c90-48dc-9560-3b476895ed7b+6:8171:x1875336462610048:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 167us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460407.838464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:1.0:1788460407.839217:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462609920 00000100:00100000:1.0:1788460407.839224:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462609920 00000100:00100000:1.0:1788460407.839267:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1788460407.839273:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2378:x1875336462609920:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788460407.839300:0:8864:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from ece97008-0c90-48dc-9560-3b476895ed7b@192.168.203.32@tcp t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:1.0:1788460407.839328:0:8864:0:(genops.c:1385:class_connect()) connect: client ece97008-0c90-48dc-9560-3b476895ed7b, cookie 0x889bb893541b7296 00002000:00100000:1.0:1788460407.839346:0:8864:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ece97008-0c90-48dc-9560-3b476895ed7b/ffff9650d0a53800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788460407.839371:0:8864:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788460407.839630:0:8864:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788460407.839658:0:8864:0:(import.c:65:import_set_state_nolock()) ffff9650d0a51800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460407.839714:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ece97008-0c90-48dc-9560-3b476895ed7b+6:2378:x1875336462609920:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 440us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460407.839722:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:1.0:1788460408.209220:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460409.229288:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460410.255822:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460410.381955:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482567040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460410.382037:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460410.382123:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567040 00000100:00100000:2.0:1788460410.382131:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567040 00000100:00100000:2.0:1788460410.382219:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460410.382230:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482567040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460410.382264:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460410.382308:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482567040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460410.382315:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788460410.382336:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788460410.382374:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c75cb800 x1875336482567040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460410.382407:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482567040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460410.382936:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482567552:0@lo:400:kworker.0 00000100:00100000:1.0:1788460410.383053:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482567168:0@lo:400:kworker.0 00000100:00100000:1.0:1788460410.383088:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460410.383116:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482567680:0@lo:400:kworker.0 00000100:00100000:1.0:1788460410.383147:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460410.383195:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567168 00000100:00100000:1.0:1788460410.383200:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567168 00000100:00100000:1.0:1788460410.383226:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788460410.383232:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482567168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460410.383268:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482567168:12345-0@lo:400:kworker.0 Request processed in 36us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460410.383275:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788460410.383302:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567680 00000100:00100000:1.0:1788460410.383306:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567680 00000100:00100000:1.0:1788460410.383335:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460410.383341:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482567680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460410.383369:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482567680:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460410.383375:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460410.383414:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482567168:0@lo:400:kworker.0 00010000:00080000:1.0:1788460410.383424:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108e300 x1875336482567680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460410.383662:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482567680:0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.383727:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460410.383771:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482567296:0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.383797:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460410.383817:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460410.383823:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482567424:0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.383855:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788460410.383885:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460410.383896:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567552 00000100:00100000:2.0:1788460410.383900:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567552 00000100:00100000:2.0:1788460410.383929:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567296 00000100:00100000:2.0:1788460410.383933:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567296 00000100:00100000:2.0:1788460410.383943:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567424 00000100:00100000:2.0:1788460410.383945:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567424 00000100:00100000:2.0:1788460410.383958:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788460410.383964:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482567552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.384102:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482567552:12345-0@lo:400:kworker.0 Request processed in 137us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460410.384109:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788460410.384124:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788460410.384129:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482567296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.384159:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482567296:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460410.384164:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788460410.384195:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788460410.384202:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482567424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.384230:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482567424:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460410.384236:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788460410.384251:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460410.384273:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482567552:0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.384296:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482567424:0@lo:400:kworker.0 00000100:00100000:2.0:1788460410.384305:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482567296:0@lo:400:kworker.0 00000100:00100000:1.0:1788460410.385131:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482567808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460410.385174:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460410.385709:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567808 00000100:00100000:2.0:1788460410.385717:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567808 00000100:00100000:2.0:1788460410.385985:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460410.385995:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482567808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460410.386027:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460410.386086:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482567808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460410.386104:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788460410.386126:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964fc2d7f100 x1875336482567808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460410.386145:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482567808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788460411.284171:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788460411.457488:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ece97008-0c90-48dc-9560-3b476895ed7b 00000001:00100000:1.0:1788460411.478282:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ece97008-0c90-48dc-9560-3b476895ed7b 00010000:00010000:1.0:1788460412.300718:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788460412.485531:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ece97008-0c90-48dc-9560-3b476895ed7b 00000100:00100000:0.0:1788460413.163281:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460413.163311:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460413.163337:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460413.163371:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460413.163395:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460413.163441:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610688 00000100:00100000:3.0:1788460413.163451:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610688 00000100:00100000:1.0:1788460413.163472:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610176 00000100:00100000:1.0:1788460413.163479:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610176 00000100:00100000:3.0:1788460413.163523:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610560 00000100:00100000:3.0:1788460413.163527:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610560 00000100:00100000:1.0:1788460413.163529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 243 00000100:00100000:1.0:1788460413.163553:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462610176:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460413.163565:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1788460413.163575:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462610688:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460413.163624:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462610688:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 47us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460413.163625:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462610176:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 71us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460413.163643:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1788460413.163653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 243 00000100:00100000:3.0:1788460413.163674:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:3.0:1788460413.163684:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462610560:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460413.163719:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462610560:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460413.163725:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00080000:0.0:1788460413.163793:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460413.163798:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460413.166952:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610432 00000100:00100000:2.0:1788460413.166969:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610432 00000100:00100000:2.0:1788460413.167045:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610304 00000100:00100000:2.0:1788460413.167050:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610304 00000100:00100000:2.0:1788460413.167083:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:2.0:1788460413.167094:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462610432:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460413.167176:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462610432:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 83us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460413.167210:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:2.0:1788460413.167230:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:2.0:1788460413.167238:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462610304:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:0.0:1788460413.167256:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460413.167279:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462610304:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 42us (3907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460413.167286:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00010000:00010000:2.0:1788460413.325162:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788460413.614437:0:10354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788460414.348351:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460415.372450:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460415.500457:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482567936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460415.500526:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460415.501054:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482568192:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501087:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460415.501110:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788460415.501116:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482568064:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501141:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460415.501163:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482568576:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501204:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460415.501229:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482568320:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501250:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460415.501266:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460415.501271:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482568448:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501288:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460415.501312:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568192 00000100:00100000:1.0:1788460415.501318:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568192 00000100:00100000:1.0:1788460415.501353:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568320 00000100:00100000:1.0:1788460415.501356:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568320 00000100:00100000:1.0:1788460415.501372:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568448 00000100:00100000:1.0:1788460415.501386:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568448 00000100:00100000:1.0:1788460415.501404:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788460415.501411:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482568192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501458:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482568192:12345-0@lo:400:kworker.0 Request processed in 46us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460415.501465:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788460415.501482:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788460415.501488:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482568320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501515:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482568320:12345-0@lo:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460415.501520:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788460415.501529:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788460415.501534:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482568448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501555:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482568448:12345-0@lo:400:kworker.0 Request processed in 21us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460415.501559:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788460415.501883:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568064 00000100:00100000:1.0:1788460415.501888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568064 00000100:00100000:1.0:1788460415.501927:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788460415.501933:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482568064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.501964:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482568064:12345-0@lo:400:kworker.0 Request processed in 32us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460415.501970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788460415.501996:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568576 00000100:00100000:1.0:1788460415.501999:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568576 00000100:00100000:1.0:1788460415.502027:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460415.502034:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482568576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.502072:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482568576:12345-0@lo:400:kworker.0 Request processed in 39us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460415.502078:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460415.502126:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482568448:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.502137:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482568320:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.502162:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482568704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460415.502206:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460415.502232:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482568064:0@lo:400:kworker.0 00010000:00080000:1.0:1788460415.502244:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3d0a80 x1875336482568576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460415.502253:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482568576:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.502261:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482568192:0@lo:400:kworker.0 00000100:00100000:1.0:1788460415.502283:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482567936 00000100:00100000:1.0:1788460415.502287:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482567936 00000100:00100000:1.0:1788460415.502305:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568704 00000100:00100000:1.0:1788460415.502307:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568704 00000100:00100000:1.0:1788460415.502318:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788460415.502323:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482567936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460415.502348:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460415.502376:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482567936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460415.502381:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788460415.502392:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788460415.502398:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482568704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460415.502419:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460415.502449:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482568704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460415.502455:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788460415.502477:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964fc2d7c380 x1875336482568704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460415.502490:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482568704:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788460415.502623:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460415.502628:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460415.502631:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788460415.502666:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fded3480 x1875336482567936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460415.502682:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482567936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460416.396462:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460417.428029:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460418.282624:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460418.282677:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460418.282709:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460418.282729:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460418.282751:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460418.282781:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611200 00000100:00100000:0.0:1788460418.282805:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611200 00000100:00100000:0.0:1788460418.282854:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611328 00000100:00100000:0.0:1788460418.282857:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611328 00000100:00100000:0.0:1788460418.282873:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1788460418.282881:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462611200:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460418.282938:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462611200:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 58us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460418.282946:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1788460418.282959:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:0.0:1788460418.282975:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462611328:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460418.282994:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462611328:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 20us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460418.283000:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00080000:0.0:1788460418.283013:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460418.283017:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460418.285388:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610944 00000100:00100000:1.0:1788460418.285401:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610944 00000100:00100000:1.0:1788460418.285470:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611072 00000100:00100000:1.0:1788460418.285474:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611072 00000100:00100000:1.0:1788460418.285506:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:1.0:1788460418.285516:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462610944:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460418.285598:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462610944:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 84us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460418.285607:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:1.0:1788460418.285625:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:1.0:1788460418.285643:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462611072:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460418.285666:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462611072:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460418.285673:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:1.0:1788460418.285692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462610816 00000100:00100000:1.0:1788460418.285695:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462610816 00000100:00100000:1.0:1788460418.285719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 245 00000100:00100000:1.0:1788460418.285734:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462610816:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460418.285758:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462610816:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460418.285764:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 245 00000100:00080000:2.0:1788460418.285956:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788460418.447032:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460419.471027:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460420.499245:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460420.620874:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482568832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460420.620942:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460420.621018:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568832 00000100:00100000:0.0:1788460420.621026:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568832 00000100:00100000:0.0:1788460420.621080:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788460420.621090:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482568832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460420.621124:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460420.621167:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482568832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460420.621174:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788460420.621219:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788460420.621248:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d0a3fb80 x1875336482568832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460420.621267:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482568832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460420.621804:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482568960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460420.621836:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460420.621908:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482568960 00000100:00100000:3.0:1788460420.621913:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482568960 00000100:00100000:3.0:1788460420.621955:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460420.621962:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482568960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460420.621981:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460420.622019:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482568960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460420.622025:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788460420.622054:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964fc2d7c700 x1875336482568960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460420.622067:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482568960:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788460420.622263:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460420.626246:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482569344:0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.626313:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460420.626349:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460420.626355:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482569472:0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.626389:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460420.626428:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569344 00000100:00100000:0.0:1788460420.626435:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569344 00000100:00100000:0.0:1788460420.626482:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569472 00000100:00100000:0.0:1788460420.626485:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569472 00000100:00100000:0.0:1788460420.626506:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788460420.626514:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482569344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.626561:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482569344:12345-0@lo:400:kworker.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460420.626569:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788460420.626583:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788460420.626590:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482569472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.626632:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482569472:12345-0@lo:400:kworker.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460420.626639:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788460420.626841:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482569472:0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.626850:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482569344:0@lo:400:kworker.0 00000100:00080000:0.0:1788460420.626882:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460420.627023:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482569088:0@lo:400:kworker.0 00000100:00100000:1.0:1788460420.627057:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460420.627094:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460420.627100:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482569216:0@lo:400:kworker.0 00000100:00100000:1.0:1788460420.627123:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460420.630709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569088 00000100:00100000:0.0:1788460420.630723:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569088 00000100:00100000:0.0:1788460420.630794:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788460420.630805:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482569088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.630890:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482569088:12345-0@lo:400:kworker.0 Request processed in 88us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460420.630897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788460420.630933:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569216 00000100:00100000:0.0:1788460420.630937:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569216 00000100:00100000:0.0:1788460420.630964:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788460420.630971:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482569216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.631002:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482569216:12345-0@lo:400:kworker.0 Request processed in 32us (3879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460420.631008:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788460420.631051:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482569216:0@lo:400:kworker.0 00000100:00100000:0.0:1788460420.631062:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482569088:0@lo:400:kworker.0 00010000:00010000:2.0:1788460421.521891:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460422.540958:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460423.407475:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460423.407560:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611584 00000100:00100000:1.0:1788460423.407570:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611584 00000100:00100000:1.0:1788460423.407658:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:1.0:1788460423.407670:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462611584:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460423.407747:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462611584:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460423.407755:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00080000:0.0:1788460423.409528:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460423.422802:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460423.422852:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460423.422880:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460423.422905:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460423.422933:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611712 00000100:00100000:1.0:1788460423.422941:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611712 00000100:00100000:1.0:1788460423.422996:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1788460423.423029:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462611712:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460423.423113:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462611712:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460423.423121:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1788460423.423146:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611968 00000100:00100000:1.0:1788460423.423150:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611968 00000100:00100000:1.0:1788460423.423173:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611840 00000100:00100000:1.0:1788460423.423175:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611840 00000100:00100000:1.0:1788460423.423218:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:1.0:1788460423.423224:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462611968:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460423.423461:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462611968:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 235us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460423.423480:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:1.0:1788460423.423494:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:1.0:1788460423.423501:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462611840:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460423.423528:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462611840:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460423.423534:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00080000:1.0:1788460423.423565:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460423.423568:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460423.423571:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460423.424778:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462611456 00000100:00100000:2.0:1788460423.424798:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462611456 00000100:00100000:2.0:1788460423.424855:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 247 00000100:00100000:2.0:1788460423.424864:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462611456:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460423.424914:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462611456:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 51us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460423.424921:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 247 00010000:00010000:0.0:1788460423.564784:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460424.589083:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460425.621719:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460425.741982:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482569728:0@lo:400:kworker.0 00000100:00100000:1.0:1788460425.742046:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460425.742123:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482569600:0@lo:400:kworker.0 00000100:00100000:0.0:1788460425.742154:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460425.742298:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482570112:0@lo:400:kworker.0 00000100:00100000:0.0:1788460425.742320:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460425.742352:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482569856:0@lo:400:kworker.0 00000100:00100000:0.0:1788460425.742380:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460425.742397:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482570368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460425.742416:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460425.742448:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788460425.742461:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482569984:0@lo:400:kworker.0 00000100:00100000:0.0:1788460425.742481:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460425.742496:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482570496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460425.742513:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460425.742535:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569728 00000100:00100000:0.0:1788460425.742542:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569728 00000100:00100000:0.0:1788460425.742588:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482570112 00000100:00100000:0.0:1788460425.742591:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482570112 00000100:00100000:0.0:1788460425.742610:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569856 00000100:00100000:0.0:1788460425.742613:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569856 00000100:00100000:0.0:1788460425.742627:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788460425.742635:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482569728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460425.742676:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482569728:12345-0@lo:400:kworker.0 Request processed in 41us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460425.742683:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788460425.742697:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788460425.742702:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482570112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460425.742729:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482570112:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460425.742734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788460425.742743:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788460425.742749:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482569856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460425.742787:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482569856:12345-0@lo:400:kworker.0 Request processed in 38us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460425.742793:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788460425.742828:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482570368 00000100:00100000:0.0:1788460425.742832:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482570368 00000100:00100000:0.0:1788460425.742849:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482570496 00000100:00100000:0.0:1788460425.742852:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482570496 00000100:00100000:0.0:1788460425.742864:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788460425.742869:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482570368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460425.742894:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460425.742924:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482570368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460425.742929:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788460425.742940:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788460425.742946:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482570496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460425.742961:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460425.742986:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482570496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460425.742991:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788460425.743008:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460425.743011:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460425.743014:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460425.743037:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482570112:0@lo:400:kworker.0 00010000:00080000:0.0:1788460425.743065:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3c4380 x1875336482570496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460425.743078:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482570496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460425.743096:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482569856:0@lo:400:kworker.0 00010000:00080000:0.0:1788460425.743104:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fded1180 x1875336482570368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460425.743114:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482570368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460425.743668:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482569728:0@lo:400:kworker.0 00000100:00100000:1.0:1788460425.743684:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482570240:0@lo:400:kworker.0 00000100:00100000:1.0:1788460425.743715:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460425.743772:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569984 00000100:00100000:1.0:1788460425.743776:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569984 00000100:00100000:1.0:1788460425.743802:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482570240 00000100:00100000:1.0:1788460425.743805:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482570240 00000100:00100000:1.0:1788460425.743822:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788460425.743828:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482569984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460425.743864:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482569984:12345-0@lo:400:kworker.0 Request processed in 36us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460425.743870:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788460425.743882:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788460425.743888:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482570240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460425.743915:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482570240:12345-0@lo:400:kworker.0 Request processed in 27us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460425.743920:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788460425.743952:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d10d5880 x1875336482570240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460425.743961:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482570240:0@lo:400:kworker.0 00010000:00080000:0.0:1788460425.744014:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d10d5c00 x1875336482569984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460425.744024:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482569984:0@lo:400:kworker.0 00000100:00100000:2.0:1788460425.744475:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482569600 00000100:00100000:2.0:1788460425.744481:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482569600 00000100:00100000:2.0:1788460425.744518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788460425.744525:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482569600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460425.744990:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482569600:12345-0@lo:400:kworker.0 Request processed in 464us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460425.744997:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788460425.745737:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482569600:0@lo:400:kworker.0 00010000:00010000:2.0:1788460426.637865:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460427.660859:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460428.524367:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460428.524421:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460428.524447:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460428.524472:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460428.524502:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460428.524519:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612096 00000100:00100000:0.0:1788460428.524548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612096 00000100:00100000:1.0:1788460428.524550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612352 00000100:00100000:1.0:1788460428.524571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612352 00000100:00100000:0.0:1788460428.524612:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 249 00000100:00100000:0.0:1788460428.524623:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462612096:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460428.524691:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462612096:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460428.524698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 249 00000100:00080000:0.0:1788460428.524729:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460428.524742:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612224 00000100:00100000:1.0:1788460428.524748:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612224 00000100:00100000:0.0:1788460428.524863:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612480 00000100:00100000:0.0:1788460428.524868:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612480 00000100:00100000:0.0:1788460428.524896:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612608 00000100:00100000:0.0:1788460428.524899:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612608 00000100:00100000:0.0:1788460428.524921:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:0.0:1788460428.524929:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2378:x1875336462612480:12345-192.168.203.32@tcp:9:kworker.0 00000100:00100000:1.0:1788460428.524944:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000020:00000080:0.0:1788460428.524949:0:8864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b728f 00000100:00080000:0.0:1788460428.524959:0:8864:0:(import.c:65:import_set_state_nolock()) ffff964fc3da7000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788460428.524964:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462612352:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460428.525010:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462612352:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 57us (588us total) trans 0 rc 0/0 00000001:00000004:0.0:1788460428.525010:0:8864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788460428.525018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1788460428.525036:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:1.0:1788460428.525044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462612224:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460428.525072:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462612224:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460428.525078:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:2.0:1788460428.525569:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1788460428.525580:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2378:x1875336462612608:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:2.0:1788460428.525595:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7296 00000100:00080000:2.0:1788460428.525600:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9650d0a51800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788460428.525636:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788460428.525865:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ece97008-0c90-48dc-9560-3b476895ed7b+2:2378:x1875336462612608:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 287us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460428.525874:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00080000:2.0:1788460428.525893:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460428.525897:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460428.525899:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788460428.527142:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460428.528228:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ece97008-0c90-48dc-9560-3b476895ed7b+2:2378:x1875336462612480:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 3293us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460428.528241:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:0.0:1788460428.528268:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460428.686167:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460429.708919:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460430.734861:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788460430.843472:0:11055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788460430.861223:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460430.861246:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482570624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460430.861317:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460430.861460:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482570624 00000100:00100000:1.0:1788460430.861467:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482570624 00000100:00100000:1.0:1788460430.861520:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460430.861530:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482570624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460430.861574:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460430.861645:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482570624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460430.861653:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460430.861691:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482570880:0@lo:400:kworker.0 00000100:00100000:1.0:1788460430.861720:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460430.861957:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482571136:0@lo:400:kworker.0 00000100:00080000:2.0:1788460430.867369:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460430.867397:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482571008:0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.867625:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460430.867669:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482570880 00000100:00100000:0.0:1788460430.867682:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482570880 00000100:00100000:0.0:1788460430.867725:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482571136 00000100:00100000:0.0:1788460430.867728:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482571136 00000100:00100000:0.0:1788460430.867771:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788460430.867780:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482570880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.867831:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482570880:12345-0@lo:400:kworker.0 Request processed in 52us (6109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460430.867838:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788460430.867855:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788460430.867861:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482571136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.867889:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482571136:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460430.867895:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788460430.867912:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460430.868937:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482570880:0@lo:400:kworker.0 00000100:00100000:1.0:1788460430.868965:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482571392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460430.869053:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460430.869090:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482571392 00000100:00100000:1.0:1788460430.869095:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482571392 00000100:00100000:1.0:1788460430.869142:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788460430.869151:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482571392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460430.869206:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460430.869241:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482571392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460430.869248:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788460430.869291:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964fc2d7c700 x1875336482571392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460430.869307:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482571392:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788460430.869535:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460430.869905:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482571136:0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.870048:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788460430.870057:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482570752:0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.870095:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460430.870152:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482571264:0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.871423:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460430.871480:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482571264 00000100:00100000:0.0:1788460430.871488:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482571264 00000100:00100000:0.0:1788460430.871536:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788460430.871555:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482571264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.871609:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482571264:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460430.871616:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788460430.871658:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d10d4a80 x1875336482571264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460430.871671:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482571264:0@lo:400:kworker.0 00000100:00100000:1.0:1788460430.871789:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482570752 00000100:00100000:1.0:1788460430.871794:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482570752 00000100:00100000:1.0:1788460430.871822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788460430.871829:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482570752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460430.871866:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482570752:12345-0@lo:400:kworker.0 Request processed in 37us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460430.871872:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788460430.874312:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482570752:0@lo:400:kworker.0 00010000:00080000:0.0:1788460430.875723:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d10d6d80 x1875336482570624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460430.875760:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482570624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460430.876028:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460430.876352:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482571008 00000100:00100000:0.0:1788460430.876360:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482571008 00000100:00100000:0.0:1788460430.876423:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788460430.876442:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482571008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460430.876501:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482571008:12345-0@lo:400:kworker.0 Request processed in 61us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460430.876508:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788460430.877148:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460430.877247:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482571008:0@lo:400:kworker.0 00010000:00010000:0.0:1788460431.757979:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788460431.937444:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ece97008-0c90-48dc-9560-3b476895ed7b 00000020:00000080:0.0:1788460431.937464:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650d0a53800/ece97008-0c90-48dc-9560-3b476895ed7b 00000020:00000080:0.0:1788460431.940235:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d0a53800/ece97008-0c90-48dc-9560-3b476895ed7b for lustre-OST0001 00000020:00000080:0.0:1788460431.940301:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650d0a51800 for lustre-OST0001 00010000:00010000:2.0:1788460432.780379:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788460432.967354:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ece97008-0c90-48dc-9560-3b476895ed7b 00000020:00000080:0.0:1788460432.967363:0:6730:0:(genops.c:885:class_export_put()) final put ffff964fc3da6800/ece97008-0c90-48dc-9560-3b476895ed7b 00000020:00000080:0.0:1788460432.967387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc3da6800/ece97008-0c90-48dc-9560-3b476895ed7b for lustre-OST0000 00000020:00000080:0.0:1788460432.967607:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc3da7000 for lustre-OST0000 00000100:00100000:1.0:1788460433.652096:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460433.652150:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460433.652274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612864 00000100:00100000:0.0:1788460433.652283:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612864 00000100:00100000:0.0:1788460433.652340:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:0.0:1788460433.652350:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462612864:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460433.652422:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462612864:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460433.652429:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00080000:0.0:1788460433.652468:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460433.652825:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460433.655735:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612992 00000100:00100000:0.0:1788460433.655747:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612992 00000100:00100000:0.0:1788460433.655817:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1788460433.655825:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462612992:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460433.655893:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462612992:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 69us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460433.655901:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00080000:1.0:1788460433.656069:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460433.657545:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462612736 00000100:00100000:3.0:1788460433.657556:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462612736 00000100:00100000:3.0:1788460433.658492:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 251 00000100:00100000:3.0:1788460433.658503:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462612736:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460433.658780:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462612736:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 170us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460433.658788:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 251 00010000:00010000:0.0:1788460433.805286:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788460434.318132:0:11205:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea5e0ef40 20000000:00000080:2.0:1788460434.318147:0:11205:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9650f5c4b000 uarg=0000000000000000 20000000:01000000:2.0:1788460434.318500:0:11205:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788460434.318507:0:11205:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788460434.318511:0:11205:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788460434.322445:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788460434.322635:0:11205:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788460434.336720:0:11205:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788460434.337609:0:11205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337634:0:11205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337643:0:11205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7242 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337650:0:11205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b7250 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337656:0:11205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b725e expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337662:0:11205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337696:0:11205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337745:0:11205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337760:0:11205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460434.337776:0:11205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571520:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460434.337884:0:11205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b725e expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.337892:0:11205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b725e expref: 22 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460434.337902:0:11205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571648:0@lo:104: 00000100:00100000:2.0:1788460434.337966:0:11205:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460434.338005:0:11205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7250 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.338014:0:11205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7250 expref: 22 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460434.338022:0:11205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571776:0@lo:104: 00010000:00010000:2.0:1788460434.338046:0:11205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b7242 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.338064:0:11205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b7242 expref: 22 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460434.338072:0:11205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571904:0@lo:104: 00010000:00010000:2.0:1788460434.338100:0:11205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460434.338108:0:11205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460434.338115:0:11205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482572032:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460434.338137:0:11205:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d2cc8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460434.342052:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788460434.342100:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460434.342148:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460434.342159:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482571648 00000100:00100000:0.0:1788460434.342217:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482571648 00000100:00100000:0.0:1788460434.342259:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482571776 00000100:00100000:0.0:1788460434.342262:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482571776 00000100:00100000:0.0:1788460434.342271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482571904 00000100:00100000:0.0:1788460434.342273:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482571904 00000100:00100000:0.0:1788460434.342285:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788460434.342293:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:11205:x1875336482571648:12345-0@lo:104: 00010000:00010000:0.0:1788460434.342311:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342376:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460434.342383:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:11205:x1875336482571648:12345-0@lo:104: Request processed in 91us (4418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460434.342400:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788460434.342435:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788460434.342442:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:11205:x1875336482571776:12345-0@lo:104: 00010000:00010000:0.0:1788460434.342450:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342480:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788460434.342485:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:11205:x1875336482571776:12345-0@lo:104: Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460434.342491:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788460434.342502:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788460434.342507:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:11205:x1875336482571904:12345-0@lo:104: 00010000:00010000:0.0:1788460434.342514:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342561:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788460434.342573:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:11205:x1875336482571904:12345-0@lo:104: Request processed in 65us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460434.342579:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788460434.342597:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788460434.342604:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342612:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460434.342616:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342625:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460434.342632:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460434.342637:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460434.342673:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342681:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460434.342713:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342720:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b725e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7265 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342732:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460434.342735:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342750:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460434.342753:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342759:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460434.342764:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460434.342768:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460434.342782:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342788:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460434.342801:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342808:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b7250 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7257 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342816:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460434.342819:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342824:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460434.342826:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342843:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460434.342851:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460434.342856:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460434.342870:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342876:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460434.342882:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342888:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b7242 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b7249 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.342901:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460434.342903:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460434.342904:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460434.342911:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460434.342915:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460434.342928:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482572160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460434.342962:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460434.343005:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482572288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460434.343028:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460434.343046:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460434.343052:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482572416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460434.343083:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460434.343113:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482572160 00000100:00100000:0.0:1788460434.343117:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482572160 00010000:00010000:0.0:1788460434.343136:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b725e expref: 23 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460434.343154:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482572288 00000100:00100000:0.0:1788460434.343157:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482572288 00010000:00010000:0.0:1788460434.343167:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7250 expref: 24 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460434.343197:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482572416 00000100:00100000:0.0:1788460434.343201:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482572416 00010000:00010000:0.0:1788460434.343212:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7242 expref: 25 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460434.343226:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788460434.343232:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+25:3317:x1875336482572160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460434.343242:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460434.343247:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b725e expref: 25 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.343255:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b725e expref: 25 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.343270:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460434.343298:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+25:3317:x1875336482572160:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460434.343304:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788460434.343316:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788460434.343330:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+24:3318:x1875336482572288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460434.343337:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460434.343341:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7250 expref: 24 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.343349:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7250 expref: 24 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.343358:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460434.343386:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+24:3318:x1875336482572288:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460434.343391:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788460434.343405:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788460434.343410:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482572416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460434.343417:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460434.343421:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b7242 expref: 23 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.343427:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b7242 expref: 23 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.343435:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460434.343454:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482572416:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460434.343460:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788460434.343496:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482572160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460434.343534:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482572416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460434.343543:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482572288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460434.344001:0:11205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008a00/0x889bb893541b7265 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b725e expref: 22 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460434.344015:0:11205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571648:0@lo:104: 00010000:00010000:1.0:1788460434.344027:0:11205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008200/0x889bb893541b7257 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7250 expref: 21 pid: 5834 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460434.344034:0:11205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571776:0@lo:104: 00010000:00010000:1.0:1788460434.344043:0:11205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166ea00/0x889bb893541b7249 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b7242 expref: 20 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460434.344051:0:11205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571904:0@lo:104: 00000100:00100000:0.0:1788460434.347642:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460434.347806:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460434.349831:0:11205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482571520:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460434.349847:0:11205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11205:1875336482572032:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460434.349940:0:11205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460434.353321:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462613248 00000100:00100000:3.0:1788460434.353336:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462613248 00010000:00010000:3.0:1788460434.353382:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 14 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460434.353585:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462613120 00000100:00100000:3.0:1788460434.353590:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462613120 00010000:00010000:3.0:1788460434.353606:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 15 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460434.353655:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1788460434.353665:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ea553450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+15:2379:x1875336462613248:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460434.353680:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460434.353687:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 15 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353708:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 15 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353726:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167e00/0x889bb893541b723b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c9 expref: 15 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353741:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460434.353813:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ea553450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462613248:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 149us (6180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460434.353820:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1788460434.353865:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1788460434.353871:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:2379:x1875336462613120:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460434.353879:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460434.353884:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353893:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353903:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5a00/0x889bb893541b7281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1208 expref: 13 pid: 5837 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353920:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353928:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353943:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353950:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353956:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353963:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353969:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460434.353973:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353981:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.353994:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460434.354004:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460434.354025:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:2379:x1875336462613120:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 153us (6220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460434.354036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00010000:00010000:1.0:1788460434.354371:0:11205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460434.354381:0:11205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460434.354387:0:11205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009200/0x889bb893541b729d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460434.828730:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460435.825754:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460435.838057:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462613376 00000100:00100000:0.0:1788460435.838074:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462613376 00000100:00100000:0.0:1788460435.838410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 252 00000100:00100000:0.0:1788460435.838421:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:5622:x1875336462613376:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460435.838439:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460435.838462:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1232 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460435.838493:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460435.838505:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460435.838525:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102166200, rc 0) 00000100:00100000:0.0:1788460435.838598:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462613376:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 179us (12853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460435.838604:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 252 00000100:00100000:2.0:1788460435.841642:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460435.841690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462613504 00000100:00100000:3.0:1788460435.841699:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462613504 00000100:00100000:3.0:1788460435.841754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 253 00000100:00100000:3.0:1788460435.841764:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462613504:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460435.842069:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462613504:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 305us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460435.842077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 253 00000100:00100000:0.0:1788460435.848548:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460435.848615:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462613632 00000100:00100000:1.0:1788460435.848635:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462613632 00000100:00100000:1.0:1788460435.848694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 254 00000100:00100000:1.0:1788460435.848704:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462613632:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460435.848934:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462613632:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 231us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.848943:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 254 00010000:00010000:0.0:1788460435.860973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460435.861172:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460435.861263:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462613760 00000100:00100000:0.0:1788460435.861272:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462613760 00000100:00100000:0.0:1788460435.861320:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 255 00000100:00100000:0.0:1788460435.861330:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462613760:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460435.861359:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460435.861375:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1239 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460435.861403:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460435.861415:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460435.861423:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102166c00, rc 0) 00000100:00100000:0.0:1788460435.861475:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462613760:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 146us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460435.861482:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 255 00000100:00100000:0.0:1788460435.869391:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460435.870929:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462613888 00000100:00100000:2.0:1788460435.870943:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462613888 00000100:00100000:2.0:1788460435.871004:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 256 00000100:00100000:2.0:1788460435.871015:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462613888:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460435.872951:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462613888:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 1928us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460435.872964:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 256 00000100:00100000:1.0:1788460435.877761:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460435.877796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462614016 00000100:00100000:1.0:1788460435.877805:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462614016 00000100:00100000:1.0:1788460435.877848:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 257 00000100:00100000:1.0:1788460435.877857:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462614016:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460435.878058:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462614016:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 201us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.878067:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 257 10000000:01000000:2.0:1788460435.981244:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460435.981253:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650efb15800 from 7 10000000:01000000:2.0:1788460435.981257:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460435.981307:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460435.981319:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460435.981339:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460435.981365:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482572544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460435.981433:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460435.981492:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6c56a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460435.981626:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482572544 00000100:00100000:3.0:1788460435.981634:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482572544 00000100:00100000:3.0:1788460435.981691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788460435.981699:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:5839:x1875336482572544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460435.981713:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460435.981727:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b72b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460435.981751:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b72b2 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460435.981762:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b72b2 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460435.981771:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5a00, rc 0) 00000100:00100000:3.0:1788460435.981810:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482572544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460435.981818:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788460435.981889:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482572544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460435.981904:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460435.981913:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460435.982322:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000040:00080000:3.0:1788460435.983104:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460435.983355:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788460435.983393:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 112 off8528 00000040:00080000:3.0:1788460435.983433:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 224 off8752 00000040:00080000:3.0:1788460435.983463:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8976 00000040:00080000:3.0:1788460435.983488:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 112 off9088 00000040:00080000:3.0:1788460435.983555:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 224 off9312 00000040:00080000:3.0:1788460435.983563:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 6 count 7 00000100:00100000:3.0:1788460435.983626:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460435.983673:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460435.983705:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460435.984714:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482572672 00000100:00100000:2.0:1788460435.984724:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482572672 00000100:00100000:2.0:1788460435.984763:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788460435.984772:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482572672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460435.984998:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482572672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460435.985006:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788460435.985287:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482572800:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985319:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.985344:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482573312:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985365:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.985385:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460435.985390:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482572928:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985422:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.985459:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482573056:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985483:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.985500:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460435.985517:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482573184:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985538:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.985564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482572800 00000100:00100000:1.0:1788460435.985568:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482572800 00000100:00100000:1.0:1788460435.985595:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482572928 00000100:00100000:1.0:1788460435.985598:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482572928 00000100:00100000:1.0:1788460435.985616:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573184 00000100:00100000:1.0:1788460435.985618:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573184 00000100:00100000:1.0:1788460435.985632:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788460435.985638:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482572800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985675:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482572800:12345-0@lo:400:kworker.0 Request processed in 37us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.985681:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788460435.985692:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788460435.985697:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482572928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482572928:12345-0@lo:400:kworker.0 Request processed in 22us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.985724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788460435.985732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788460435.985737:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482573184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482573184:12345-0@lo:400:kworker.0 Request processed in 22us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.985764:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788460435.985778:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573312 00000100:00100000:1.0:1788460435.985786:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573312 00000100:00100000:1.0:1788460435.985820:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573056 00000100:00100000:1.0:1788460435.985822:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573056 00000100:00100000:1.0:1788460435.985836:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788460435.985841:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482573312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985866:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482573312:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.985872:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788460435.985880:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788460435.985884:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482573056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.985905:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482573056:12345-0@lo:400:kworker.0 Request processed in 20us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.985911:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788460435.985971:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460435.985975:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460435.985977:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460435.986003:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482572928:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.986014:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482572800:0@lo:400:kworker.0 00010000:00080000:1.0:1788460435.986025:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d10d5c00 x1875336482573312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460435.986035:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482573312:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.986065:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482573184:0@lo:400:kworker.0 00010000:00080000:1.0:1788460435.986074:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d10d4a80 x1875336482573056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460435.986081:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482573056:0@lo:400:kworker.0 00000100:00100000:1.0:1788460435.987340:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482573440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460435.987393:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.987470:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573440 00000100:00100000:1.0:1788460435.987476:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573440 00000100:00100000:1.0:1788460435.987523:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788460435.987531:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482573440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460435.987563:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460435.987601:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482573440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.987608:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788460435.987631:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482573568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460435.987653:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.987682:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573568 00000100:00100000:1.0:1788460435.987686:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573568 00000100:00100000:1.0:1788460435.987701:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788460435.987706:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482573568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460435.987725:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460435.987755:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482573568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.987760:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788460435.987791:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fded1500 x1875336482573440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460435.987821:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482573440:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788460435.987860:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650f6056300 x1875336482573568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460435.987887:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482573568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460435.992150:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460435.992254:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482573696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460435.992329:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460435.992376:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460435.993785:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573696 00000100:00100000:1.0:1788460435.993810:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573696 00000100:00100000:1.0:1788460435.993872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788460435.993881:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482573696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460435.994101:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482573696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.994109:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788460435.994167:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482573696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788460435.994700:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460435.994768:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482573824:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460435.994812:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.994833:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460435.994848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573824 00000100:00100000:1.0:1788460435.994853:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573824 00000100:00100000:1.0:1788460435.994877:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788460435.994884:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482573824:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460435.995014:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482573824:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 130us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.995021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788460435.995061:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482573824:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460435.995302:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788460435.995348:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 112 off8528 00000040:00080000:1.0:1788460435.995397:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 224 off8752 00000040:00080000:1.0:1788460435.995443:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8976 00000040:00080000:1.0:1788460435.995477:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 112 off9088 00000100:00100000:1.0:1788460435.995500:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482573952:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460435.995545:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460435.995561:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460435.995575:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482573952 00000100:00100000:1.0:1788460435.995578:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482573952 00000100:00100000:1.0:1788460435.995601:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788460435.995607:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482573952:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460435.995716:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482573952:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 109us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460435.995723:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788460435.995761:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482573952:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460435.995831:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 224 off9312 00000040:00080000:1.0:1788460435.995839:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:2.0:1788460436.011622:0:11235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 64768 count 7 00000020:01000000:3.0:1788460436.028542:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788460436.028563:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460436.028575:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.028603:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460436.028619:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788460436.028621:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650f6139800 from 7 10000000:01000000:3.0:1788460436.028624:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460436.028662:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.028669:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.028679:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460436.028704:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.028769:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460436.028822:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460436.029099:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574080 00000100:00100000:2.0:1788460436.029108:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574080 00000100:00100000:2.0:1788460436.029162:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788460436.029171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482574080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460436.029215:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460436.029230:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b72c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460436.029255:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b72c0 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460436.029265:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b72c0 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460436.029286:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009c00, rc 0) 00000100:00100000:2.0:1788460436.029332:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460436.029338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788460436.029488:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460436.029513:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.029523:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460436.029922:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:3.0:1788460436.030750:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460436.030984:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788460436.031037:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1788460436.031088:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1788460436.031129:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1788460436.031165:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1788460436.031284:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1788460436.031294:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:3.0:1788460436.031371:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.031431:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460436.031476:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460436.033221:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574208 00000100:00100000:2.0:1788460436.033234:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574208 00000100:00100000:2.0:1788460436.033289:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788460436.033299:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460436.033616:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460436.033624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788460436.034592:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.034649:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.034705:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460436.034776:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460436.040103:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574336 00000100:00100000:1.0:1788460436.040121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574336 00000100:00100000:0.0:1788460436.040384:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788460436.040394:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460436.040698:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 305us (5992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460436.040706:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788460436.040925:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460436.042276:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460436.042362:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574464:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.042434:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460436.042484:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460436.043288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574464 00000100:00100000:0.0:1788460436.043296:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574464 00000100:00100000:0.0:1788460436.043338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788460436.043346:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574464:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460436.043553:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574464:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 207us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460436.043570:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788460436.043695:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574464:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460436.044054:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788460436.044108:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1788460436.044161:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1788460436.044231:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1788460436.044267:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000100:00100000:1.0:1788460436.044301:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574592:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460436.044349:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460436.044375:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460436.044537:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574592 00000100:00100000:3.0:1788460436.044543:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574592 00000100:00100000:3.0:1788460436.044585:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788460436.044593:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574592:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.044746:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574592:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 154us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460436.044754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788460436.044797:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574592:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460436.044897:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788460436.044909:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:0.0:1788460436.046747:0:11237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64768 count 7 00000020:01000000:3.0:1788460436.047906:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788460436.047922:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460436.047934:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.047947:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460436.048003:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788460436.048006:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5118800 from 7 10000000:01000000:3.0:1788460436.048009:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460436.048055:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.048063:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.048074:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460436.048100:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.048161:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460436.049697:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460436.055016:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574720 00000100:00100000:0.0:1788460436.055031:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574720 00000100:00100000:0.0:1788460436.055138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788460436.055148:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482574720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460436.055164:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460436.055207:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b72ce expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460436.055235:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b72ce expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460436.055246:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b72ce expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460436.055254:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102166400, rc 0) 00000100:00100000:0.0:1788460436.055324:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482574720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (7162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460436.055330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788460436.055414:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460436.055432:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460436.055459:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460436.055521:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.055555:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460436.060428:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460436.060559:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574848 00000100:00100000:1.0:1788460436.060586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574848 00000100:00100000:2.0:1788460436.062419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788460436.062442:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482574848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460436.062803:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482574848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460436.062812:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788460436.062894:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.062941:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460436.062999:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460436.063338:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460436.063415:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482574976 00000100:00100000:0.0:1788460436.063423:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482574976 00000100:00100000:0.0:1788460436.063457:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788460436.063465:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482574976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460436.063682:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482574976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460436.063689:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788460436.063825:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482574976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460436.065238:0:11238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788460436.065431:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788460436.065441:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460436.065453:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460436.065464:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460436.876854:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460437.901445:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460438.769988:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460438.770024:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460438.770048:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460438.770075:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462614400 00000100:00100000:1.0:1788460438.770084:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462614400 00000100:00100000:1.0:1788460438.770136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462614272 00000100:00100000:1.0:1788460438.770139:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462614272 00000100:00100000:1.0:1788460438.770163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:1.0:1788460438.770173:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462614400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460438.770258:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462614400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460438.770264:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:1.0:1788460438.770281:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:1.0:1788460438.770288:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462614272:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460438.770311:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462614272:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460438.770317:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00080000:1.0:1788460438.770336:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460438.770839:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462614144 00000100:00100000:2.0:1788460438.770845:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462614144 00000100:00100000:2.0:1788460438.770883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 271 00000100:00100000:2.0:1788460438.770891:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462614144:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460438.770938:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462614144:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 48us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460438.770945:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 271 00010000:00010000:0.0:1788460438.925385:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788460439.203044:0:11404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788460439.949129:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460440.975457:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460441.101284:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482575232:0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.101399:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460441.101442:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482575744:0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.101482:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460441.101514:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788460441.101520:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482575360:0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.101543:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460441.101577:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482575872:0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.101603:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460441.101623:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482575744 00000100:00100000:2.0:1788460441.101630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482575744 00000100:00100000:2.0:1788460441.101685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482575360 00000100:00100000:2.0:1788460441.101689:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482575360 00000100:00100000:2.0:1788460441.101709:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788460441.101718:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482575744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460441.101768:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482575744:12345-0@lo:400:kworker.0 Request processed in 51us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460441.101776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788460441.101793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788460441.101799:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482575360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460441.101824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482575360:12345-0@lo:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460441.101830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788460441.102047:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460441.104116:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482575104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460441.104199:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460441.104235:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482575616:0@lo:400:kworker.0 00000100:00100000:3.0:1788460441.104256:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460441.104311:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788460441.104317:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482575488:0@lo:400:kworker.0 00000100:00100000:3.0:1788460441.104357:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460441.104377:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482576000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460441.104398:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460441.104433:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482575104 00000100:00100000:3.0:1788460441.104453:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482575104 00000100:00100000:3.0:1788460441.104508:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576000 00000100:00100000:3.0:1788460441.104519:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576000 00000100:00100000:3.0:1788460441.104535:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788460441.104543:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482575104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460441.104576:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460441.104618:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482575104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460441.104625:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788460441.104641:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460441.104646:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482576000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460441.104680:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460441.104707:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482576000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460441.104713:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460441.105420:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482575872 00000100:00100000:3.0:1788460441.105428:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482575872 00000100:00100000:3.0:1788460441.105464:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482575616 00000100:00100000:3.0:1788460441.105467:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482575616 00000100:00100000:3.0:1788460441.105495:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460441.105502:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482575872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460441.105552:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482575872:12345-0@lo:400:kworker.0 Request processed in 51us (3948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460441.105558:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460441.105570:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788460441.105575:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482575616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460441.105596:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482575616:12345-0@lo:400:kworker.0 Request processed in 22us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460441.105611:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788460441.105633:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460441.105637:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460441.105651:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482575488 00000100:00100000:3.0:1788460441.105654:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482575488 00000100:00100000:3.0:1788460441.105681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788460441.105687:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482575488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460441.105714:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482575488:12345-0@lo:400:kworker.0 Request processed in 27us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460441.105720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788460441.105733:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460441.105758:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482575488:0@lo:400:kworker.0 00010000:00080000:3.0:1788460441.105771:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fded3100 x1875336482576000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460441.105787:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482576000:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788460441.105797:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff964fc2d7c700 x1875336482575104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460441.105809:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482575104:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788460441.105818:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3c4000 x1875336482575616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460441.105825:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482575616:0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.106145:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482575232 00000100:00100000:0.0:1788460441.106149:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482575232 00000100:00100000:0.0:1788460441.106199:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788460441.106206:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482575232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.106241:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482575232:12345-0@lo:400:kworker.0 Request processed in 36us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460441.106247:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788460441.106302:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482575360:0@lo:400:kworker.0 00010000:00080000:0.0:1788460441.106313:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3c7b80 x1875336482575872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460441.106322:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482575872:0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.106329:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482575232:0@lo:400:kworker.0 00000100:00100000:0.0:1788460441.106339:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482575744:0@lo:400:kworker.0 00010000:00010000:0.0:1788460441.996621:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460443.020487:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460443.134490:0:11504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:34:00 (1788460440) === 00000100:00100000:1.0:1788460443.399811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.407091:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462614656 00000100:00100000:2.0:1788460443.407107:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462614656 00000100:00080000:3.0:1788460443.407136:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460443.407171:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1788460443.407210:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:9725:x1875336462614656:12345-192.168.203.32@tcp:700:mkdir.0 00000100:00100000:2.0:1788460443.407314:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:9725:x1875336462614656:12345-192.168.203.32@tcp:700:mkdir.0 Request processed in 110us (7512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460443.407321:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1788460443.407653:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460443.408745:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462614528 00000100:00100000:1.0:1788460443.411611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.411794:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462614912 00000100:00100000:3.0:1788460443.411816:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462614912 00000100:00100000:3.0:1788460443.411872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460443.411889:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:9725:x1875336462614912:12345-192.168.203.32@tcp:36:mkdir.0 00010000:00010000:3.0:1788460443.411941:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460443.411993:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b719a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11b4 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.412012:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:3.0:1788460443.412022:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460443.412381:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.412394:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.412405:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.412433:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.412441:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.412449:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460443.413732:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788460443.413746:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.413766:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.413783:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.413789:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460443.413794:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.413802:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.413814:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:2.0:1788460443.413817:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460443.413820:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.413826:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b72dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460443.413844:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000711ed066 reply state 0000000076236cd7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460443.413852:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460443.413960:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:9725:x1875336462614912:12345-192.168.203.32@tcp:36:mkdir.0 Request processed in 2077us (2364us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788460443.413969:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:0.0:1788460443.414074:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462614528 00000100:00100000:0.0:1788460443.414124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:0.0:1788460443.414133:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462614528:12345-192.168.203.32@tcp:41:mkdir.0 00000004:00000024:0.0:1788460443.414163:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788460443.414215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462614528:12345-192.168.203.32@tcp:41:mkdir.0 Request processed in 83us (6564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460443.414222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:0.0:1788460443.419988:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.420007:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.420015:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.420021:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460443.420039:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.420047:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.420065:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9650c52ed600) 00010000:00010000:0.0:1788460443.420068:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460443.420073:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.420079:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b72e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460443.437516:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.437625:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462615040 00000100:00100000:2.0:1788460443.437635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462615040 00000100:00100000:2.0:1788460443.437688:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1788460443.437698:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:9726:x1875336462615040:12345-192.168.203.32@tcp:101:chmod.0 00010000:00010000:2.0:1788460443.437734:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460443.437756:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b72ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1240 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.437818:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b72f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.437831:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b72f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.437842:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b72f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460443.437874:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460443.437886:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460443.437924:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b72f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.437948:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b72ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1240 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.437965:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b72f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1240 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.437972:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0600) 00010000:00010000:2.0:1788460443.437975:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460443.437978:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460443.438036:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:9726:x1875336462615040:12345-192.168.203.32@tcp:101:chmod.0 Request processed in 340us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460443.438042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1788460443.442628:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.442766:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462615296 00000100:00100000:3.0:1788460443.442776:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462615296 00000100:00100000:3.0:1788460443.442837:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1788460443.442846:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:9726:x1875336462615296:12345-192.168.203.32@tcp:36:chmod.0 00010000:00010000:3.0:1788460443.442922:0:7007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460443.442949:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b72f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1240 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.442966:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0600) 00010000:00010000:3.0:1788460443.442976:0:7007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460443.443001:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.443014:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.443025:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460443.443821:0:7007:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001601dac4 reply state 00000000786e8972 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460443.443835:0:7007:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788460443.443843:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788460443.443946:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:9726:x1875336462615296:12345-192.168.203.32@tcp:36:chmod.0 Request processed in 1097us (1324us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788460443.443955:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00010000:00010000:2.0:1788460443.448016:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.448047:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.448055:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.448061:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460443.448066:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.448073:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.448097:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52ed100) 00010000:00010000:2.0:1788460443.448101:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460443.448106:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.448112:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b72f8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460443.486554:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.486649:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462615424 00000100:00100000:2.0:1788460443.486658:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462615424 00000100:00100000:2.0:1788460443.486718:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1788460443.486728:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:9727:x1875336462615424:12345-192.168.203.32@tcp:101:chown.0 00010000:00010000:2.0:1788460443.486751:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460443.486773:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b72ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1247 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.486853:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7306 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.486866:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.486878:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460443.486909:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460443.486913:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460443.486948:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.486973:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b72ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1247 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.486990:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1247 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.486998:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:2.0:1788460443.487001:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460443.487005:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009e00, rc 0) 00000100:00100000:2.0:1788460443.487074:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:9727:x1875336462615424:12345-192.168.203.32@tcp:101:chown.0 Request processed in 347us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460443.487082:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460443.494100:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.494247:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462615552 00000100:00100000:2.0:1788460443.494256:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462615552 00000100:00100000:2.0:1788460443.494329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1788460443.494348:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:9727:x1875336462615552:12345-192.168.203.32@tcp:101:chown.0 00010000:00010000:2.0:1788460443.494369:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460443.494387:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b730d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d124e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494450:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494472:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494483:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494507:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494519:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494601:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494609:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494616:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460443.494653:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460443.494657:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460443.494673:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494684:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494689:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494695:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494700:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460443.494704:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494711:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494722:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:2.0:1788460443.494725:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460443.494729:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494735:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494919:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494938:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494944:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494949:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460443.494953:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494959:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494968:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9650c3cb0f00) 00010000:00010000:2.0:1788460443.494971:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460443.494974:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.494979:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b731b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.495011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b730d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d124e expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.495024:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d124e expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.495032:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460443.495034:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460443.495043:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009200, rc 0) 00000100:00100000:2.0:1788460443.495100:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:9727:x1875336462615552:12345-192.168.203.32@tcp:101:chown.0 Request processed in 754us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460443.495108:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460443.499781:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.499934:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462615808 00000100:00100000:2.0:1788460443.499945:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462615808 00000100:00100000:2.0:1788460443.500001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:2.0:1788460443.500010:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:9727:x1875336462615808:12345-192.168.203.32@tcp:36:chown.0 00010000:00010000:2.0:1788460443.500070:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460443.500095:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d124e expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.500112:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460443.500130:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460443.500156:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.500168:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460443.500236:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788460443.546857:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788460443.547021:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002c1b34e reply state 0000000009989d45 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460443.547034:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788460443.547048:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788460443.547169:0:5844:0:(ldlm_lib.c:3499:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788460443.547217:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:9727:x1875336462615808:12345-192.168.203.32@tcp:36:chown.0 Request processed in 47199us (47435us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788460443.547227:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00010000:00010000:1.0:1788460443.547425:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.547434:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.547441:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.547446:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460443.547451:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.547470:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.547496:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c3cb0600) 00010000:00010000:1.0:1788460443.547500:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788460443.547504:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.547509:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7329 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460443.570414:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.570926:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462615936 00000100:00100000:2.0:1788460443.570935:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462615936 00000100:00100000:2.0:1788460443.570996:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1788460443.571006:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:9728:x1875336462615936:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:2.0:1788460443.571041:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460443.571062:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1255 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460443.575469:0:5842:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4152us 00010000:00010000:3.0:1788460443.606814:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.606837:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.606847:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.606872:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.606890:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.606898:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607267:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b7345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607277:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b7345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607284:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b7345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460443.607305:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460443.607310:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460443.607472:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b7345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607552:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607561:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607568:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607583:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460443.607588:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607596:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607609:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:3.0:1788460443.607612:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460443.607616:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607623:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b7337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607634:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607639:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607644:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607649:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460443.607651:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607656:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607674:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9650c52ed500) 00010000:00010000:3.0:1788460443.607677:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460443.607680:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607686:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b733e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607723:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1255 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607738:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b7345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1255 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.607745:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460443.607747:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788460443.607749:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4200, rc 0) 00000100:00100000:3.0:1788460443.607815:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:9728:x1875336462615936:12345-192.168.203.32@tcp:101:touch.500 Request processed in 36810us (37411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460443.607824:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1788460443.612908:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460443.613112:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462616192 00000100:00100000:1.0:1788460443.613130:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462616192 00000100:00100000:1.0:1788460443.613214:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:1.0:1788460443.613225:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:9728:x1875336462616192:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:1.0:1788460443.613246:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460443.613278:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e000/0x889bb893541b734c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d125c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.613568:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.613582:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.613593:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.613653:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.613661:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.613668:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788460443.616577:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788460443.618287:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ea00/0x889bb893541b7361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618309:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ea00/0x889bb893541b7361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618321:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ea00/0x889bb893541b7361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618375:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618397:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618404:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618410:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166ee00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460443.618415:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618422:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618434:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:1.0:1788460443.618436:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460443.618441:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618447:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ee00/0x889bb893541b7353 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460443.618471:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000404d57f6 reply state 00000000de478799 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460443.618480:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788460443.618530:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e000/0x889bb893541b734c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d125c expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618546:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ea00/0x889bb893541b7361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d125c expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.618564:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650c34d0400) 00010000:00010000:1.0:1788460443.618566:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460443.618568:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166ea00, rc 0) 00000100:00100000:1.0:1788460443.618645:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:9728:x1875336462616192:12345-192.168.203.32@tcp:101:touch.500 Request processed in 5421us (5745us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788460443.618654:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00010000:00010000:0.0:1788460443.621660:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.621678:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.621686:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.621712:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460443.621718:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.621726:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.621740:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48165769 (ffff9650c34d0b00) 00010000:00010000:0.0:1788460443.621743:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460443.622299:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.622310:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166f400/0x889bb893541b735a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460443.626409:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460443.626600:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462616448 00000100:00100000:1.0:1788460443.626611:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462616448 00000100:00100000:1.0:1788460443.626673:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1788460443.626682:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:9728:x1875336462616448:12345-192.168.203.32@tcp:36:touch.500 00010000:00010000:1.0:1788460443.626742:0:7007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460443.626781:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166ea00/0x889bb893541b7361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d125c expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.626800:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650c34d0400) 00010000:00010000:1.0:1788460443.626809:0:7007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460443.626848:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.626860:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460443.626869:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460443.627008:0:7007:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000516a77bb reply state 000000000c3441d9 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460443.627034:0:7007:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460443.627119:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:9728:x1875336462616448:12345-192.168.203.32@tcp:36:touch.500 Request processed in 437us (718us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788460443.627126:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00010000:00010000:0.0:1788460443.630709:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.630727:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.630735:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.630742:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166e600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460443.630755:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.630764:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.630797:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:0.0:1788460443.630800:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460443.630804:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.630810:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c166e600/0x889bb893541b736f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460443.633347:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460443.633429:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462616576 00000100:00100000:0.0:1788460443.633439:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462616576 00000100:00100000:0.0:1788460443.633511:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1788460443.633522:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:9728:x1875336462616576:12345-192.168.203.32@tcp:101:touch.500 00010000:00010000:0.0:1788460443.633545:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460443.633566:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff965102167e00/0x889bb893541b7376 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1263 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.633633:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff965102167e00/0x889bb893541b7376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1263 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.633648:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff965102167e00/0x889bb893541b7376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1263 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.633665:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:0.0:1788460443.633669:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460443.633672:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167e00, rc 0) 00000100:00100000:0.0:1788460443.633731:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:9728:x1875336462616576:12345-192.168.203.32@tcp:101:touch.500 Request processed in 211us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460443.633738:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:1.0:1788460443.637850:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.637983:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462616704 00000100:00100000:3.0:1788460443.637992:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462616704 00000100:00100000:3.0:1788460443.638038:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1788460443.638047:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2378:x1875336462616704:12345-192.168.203.32@tcp:8:touch.500 00010000:00080000:3.0:1788460443.638078:0:8864:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from 9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:3.0:1788460443.638133:0:8864:0:(genops.c:1385:class_connect()) connect: client 9e69358b-6b5d-4a87-b6fb-534c610a3920, cookie 0x889bb893541b737d 00002000:00100000:3.0:1788460443.638146:0:8864:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e69358b-6b5d-4a87-b6fb-534c610a3920/ffff9650fcac0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460443.638168:0:8864:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460443.638434:0:8864:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788460443.638473:0:8864:0:(import.c:65:import_set_state_nolock()) ffff9650fcac7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460443.638536:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f60ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2378:x1875336462616704:12345-192.168.203.32@tcp:8:touch.500 Request processed in 488us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460443.638544:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460443.642660:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.642898:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462616832 00000100:00100000:3.0:1788460443.642908:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462616832 00000100:00080000:0.0:1788460443.643023:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460443.643108:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460443.643129:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:0:x1875336462616832:12345-192.168.203.32@tcp:2:touch.500 00000100:00100000:3.0:1788460443.693460:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:0:x1875336462616832:12345-192.168.203.32@tcp:2:touch.500 Request processed in 50323us (50789us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788460443.693473:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000001:00080000:2.0:1788460443.693651:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1788460443.693663:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000100:00100000:2.0:1788460443.696854:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.697069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462617088 00000100:00100000:3.0:1788460443.697080:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462617088 00000100:00100000:3.0:1788460443.697233:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1788460443.697245:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:9728:x1875336462617088:12345-192.168.203.32@tcp:35:touch.500 00000100:00100000:3.0:1788460443.697694:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:9728:x1875336462617088:12345-192.168.203.32@tcp:35:touch.500 Request processed in 450us (847us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788460443.697703:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1788460443.722322:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.722652:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462617216 00000100:00100000:3.0:1788460443.722662:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462617216 00000100:00100000:3.0:1788460443.722725:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1788460443.722736:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:9729:x1875336462617216:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1788460443.722783:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460443.722804:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b7384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d126a expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.722864:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b738b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.722877:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b738b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.722888:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b738b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460443.722920:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460443.722924:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460443.722957:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b738b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.722981:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b7384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d126a expref: 13 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.722998:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b738b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d126a expref: 12 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.723006:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460443.723008:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460443.723012:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4e00, rc 0) 00000100:00100000:3.0:1788460443.723060:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+12:9729:x1875336462617216:12345-192.168.203.32@tcp:101:rm.0 Request processed in 326us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460443.723067:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1788460443.729096:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460443.729258:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462617472 00000100:00100000:0.0:1788460443.729267:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462617472 00000100:00100000:0.0:1788460443.729334:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1788460443.729345:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+12:9729:x1875336462617472:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:0.0:1788460443.729364:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460443.729382:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1271 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460443.729477:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788460443.729641:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7392 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1271 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.729654:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:0.0:1788460443.729657:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460443.729661:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1271 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.729673:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a800, rc 0) 00000100:00100000:0.0:1788460443.729742:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:9729:x1875336462617472:12345-192.168.203.32@tcp:101:rm.0 Request processed in 398us (654us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788460443.729757:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1788460443.742481:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.743064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462617600 00000100:00100000:3.0:1788460443.743074:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462617600 00000100:00100000:3.0:1788460443.743144:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1788460443.743154:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:9729:x1875336462617600:12345-192.168.203.32@tcp:37:rm.0 00000100:00100000:2.0:1788460443.753200:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:9729:x1875336462617600:12345-192.168.203.32@tcp:37:rm.0 Request processed in 10007us (10687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460443.753213:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1788460443.770478:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.772763:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462617856 00000100:00100000:3.0:1788460443.772779:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462617856 00000100:00100000:3.0:1788460443.772851:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1788460443.772861:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c802fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:9729:x1875336462617856:12345-192.168.203.32@tcp:35:rm.0 00000100:00100000:3.0:1788460443.773461:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c802fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:9729:x1875336462617856:12345-192.168.203.32@tcp:35:rm.0 Request processed in 589us (2978us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788460443.773470:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460443.784759:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.784872:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462618112 00000100:00100000:3.0:1788460443.784882:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462618112 00000100:00100000:3.0:1788460443.784942:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1788460443.784952:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:9729:x1875336462618112:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1788460443.784978:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460443.784997:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b73a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1278 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.785106:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b73a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.785120:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b73a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.785133:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b73a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460443.785154:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788460443.785589:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b73a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1278 expref: 17 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.785606:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b73a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1278 expref: 16 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.785614:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460443.785617:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788460443.785620:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d800, rc 0) 00000100:00100000:3.0:1788460443.785676:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:9729:x1875336462618112:12345-192.168.203.32@tcp:101:rm.0 Request processed in 726us (927us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788460443.785684:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1788460443.789865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460443.789994:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462618240 00000100:00100000:0.0:1788460443.790004:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462618240 00000100:00100000:0.0:1788460443.790056:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1788460443.790065:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:9729:x1875336462618240:12345-192.168.203.32@tcp:41:rm.0 00000004:00000024:0.0:1788460443.790121:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788460443.790247:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:9729:x1875336462618240:12345-192.168.203.32@tcp:41:rm.0 Request processed in 182us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460443.790255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:1.0:1788460443.793648:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.793784:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462618368 00000100:00100000:2.0:1788460443.793794:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462618368 00000100:00100000:3.0:1788460443.793947:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:3.0:1788460443.793960:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:9729:x1875336462618368:12345-192.168.203.32@tcp:101:rm.0 00010000:00010000:3.0:1788460443.793980:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460443.793998:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d127f expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794055:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794070:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794081:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794112:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794120:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794128:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794612:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b73ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794623:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b73ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794631:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b73ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460443.794657:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788460443.794661:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460443.794677:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b73ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794688:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b73ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794696:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794703:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794720:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794727:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460443.794732:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794741:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794753:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460443.794756:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460443.794760:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794767:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794780:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794786:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794793:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794798:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460443.794801:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.794818:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.795019:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48165769 (ffff9650c52ed900) 00010000:00010000:3.0:1788460443.795024:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460443.795029:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.795035:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.795070:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d127f expref: 18 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.795082:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b73ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d127f expref: 17 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.795090:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:3.0:1788460443.795092:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460443.795095:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029ce00, rc 0) 00000100:00100000:3.0:1788460443.795261:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:9729:x1875336462618368:12345-192.168.203.32@tcp:101:rm.0 Request processed in 1304us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460443.795270:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:2.0:1788460443.804898:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460443.815923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462618624 00000100:00100000:0.0:1788460443.815938:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462618624 00000100:00100000:0.0:1788460443.816002:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:0.0:1788460443.816012:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:9729:x1875336462618624:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:0.0:1788460443.816064:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788460443.816089:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b73ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d127f expref: 17 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816113:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff965102167e00/0x889bb893541b7376 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1263 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816124:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:0.0:1788460443.816140:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4e00/0x889bb893541b738b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d126a expref: 15 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816148:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:0.0:1788460443.816151:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460443.816168:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816218:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816239:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816269:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816278:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816284:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816759:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816769:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.816777:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460443.819742:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788460443.819756:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317055576836ns, next at 318055573736ns, rc = 0 00010000:00010000:0.0:1788460443.819826:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819860:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819871:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819879:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819898:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819903:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819930:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460443.819951:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819957:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819964:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819969:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460443.819973:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819981:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.819993:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460443.819995:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788460443.820000:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820006:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b73df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820024:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820036:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820043:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820048:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ae00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460443.820051:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820057:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820066:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:0.0:1788460443.820069:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460443.820072:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.820078:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b73d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460443.820089:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d7b734c reply state 000000000e96f941 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460443.820098:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460443.820171:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:9729:x1875336462618624:12345-192.168.203.32@tcp:36:rm.0 Request processed in 4156us (15277us total) trans 4294967306 rc 0/0 00010000:00010000:3.0:1788460443.821098:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460443.821107:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.821115:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ba00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460443.821127:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.821134:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.821146:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460443.821148:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788460443.821152:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.821157:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b73e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.821175:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460443.821196:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460443.821198:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460443.821251:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00010000:00010000:0.0:1788460443.821727:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.821747:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.821754:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.821758:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460443.821762:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.821769:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.821777:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48165769 (ffff9650d2c3c700) 00010000:00010000:0.0:1788460443.821780:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460443.821783:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.821788:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b400/0x889bb893541b73d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48165769 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460443.824618:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.824700:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462618880 00000100:00100000:3.0:1788460443.824710:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462618880 00000100:00100000:3.0:1788460443.824766:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1788460443.824775:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:9729:x1875336462618880:12345-192.168.203.32@tcp:35:rm.0 00000100:00100000:3.0:1788460443.825023:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:9729:x1875336462618880:12345-192.168.203.32@tcp:35:rm.0 Request processed in 248us (412us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788460443.825031:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1788460443.827823:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460443.828029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462619136 00000100:00100000:3.0:1788460443.828038:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462619136 00000100:00100000:3.0:1788460443.828089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1788460443.828097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:9729:x1875336462619136:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:3.0:1788460443.828145:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788460443.828204:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b73a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1278 expref: 16 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828389:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b7345 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1255 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828402:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460443.828417:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7306 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1247 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828426:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:3.0:1788460443.828432:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460443.828463:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828476:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828668:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828681:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828689:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.828696:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.829639:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.829661:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.829670:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460443.832684:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788460443.832708:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832718:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832725:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832731:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460443.832735:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832742:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832757:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460443.832760:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788460443.832764:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832771:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b73fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832798:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832812:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832818:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832823:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460443.832826:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832832:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832840:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52ed900) 00010000:00010000:3.0:1788460443.832843:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460443.832845:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460443.832850:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b73ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460443.832863:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc50fb78 reply state 000000003b6d969d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460443.832871:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460443.832970:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:9729:x1875336462619136:12345-192.168.203.32@tcp:36:rm.0 Request processed in 4869us (5151us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788460443.832979:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00010000:00010000:0.0:1788460443.854720:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.854738:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.854955:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.854985:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460443.855109:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.855118:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.855134:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9650c52ed500) 00010000:00010000:0.0:1788460443.855136:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460443.855141:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460443.855147:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b73f4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460443.886159:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460443.887018:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460443.887618:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462619392 00000100:00100000:0.0:1788460443.887628:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462619392 00000100:00100000:0.0:1788460443.887706:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:0.0:1788460443.887717:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462619392:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460443.887799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462619392:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 84us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460443.887807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:1.0:1788460443.887923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462619264 00000100:00100000:1.0:1788460443.887928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462619264 00000100:00100000:1.0:1788460443.887966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 273 00000100:00100000:1.0:1788460443.887973:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462619264:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460443.888002:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462619264:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 30us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460443.888008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 273 00000100:00080000:3.0:1788460443.897260:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460444.046943:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460445.069559:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460446.095254:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788460446.220964:0:7952:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319456782329ns, next at 320456780282ns, rc = 0 00000100:00100000:3.0:1788460446.220995:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482576128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460446.221060:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460446.221099:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576128 00000100:00100000:1.0:1788460446.221108:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576128 00000100:00100000:1.0:1788460446.221203:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460446.221213:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482576128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460446.221244:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460446.221290:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482576128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460446.221312:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788460446.221338:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460446.221353:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482576640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460446.221372:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482576384:0@lo:400:kworker.0 00000100:00100000:1.0:1788460446.221382:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460446.221414:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788460446.221429:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3c6a00 x1875336482576128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460446.221454:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460446.221459:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482576128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460446.221464:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482576256:0@lo:400:kworker.0 00000100:00100000:1.0:1788460446.221481:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460446.221490:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482576512:0@lo:400:kworker.0 00000100:00100000:2.0:1788460446.221497:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460446.221524:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460446.221559:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576384 00000100:00100000:1.0:1788460446.221563:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576384 00000100:00100000:1.0:1788460446.221590:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576512 00000100:00100000:1.0:1788460446.221594:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576512 00000100:00100000:0.0:1788460446.221621:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460446.221624:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788460446.221630:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482576768:0@lo:400:kworker.0 00000100:00100000:1.0:1788460446.221631:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482576384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460446.221657:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460446.221660:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482576384:12345-0@lo:400:kworker.0 Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460446.221667:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788460446.221675:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482576384:0@lo:400:kworker.0 00000100:00100000:1.0:1788460446.221677:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576768 00000100:00100000:1.0:1788460446.221680:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576768 00000100:00100000:1.0:1788460446.221694:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788460446.221699:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482576512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460446.221739:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482576512:12345-0@lo:400:kworker.0 Request processed in 40us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460446.221745:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788460446.221764:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788460446.221770:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482576768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460446.221816:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482576768:12345-0@lo:400:kworker.0 Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460446.221823:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788460446.221845:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460446.221852:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576640 00000100:00100000:1.0:1788460446.221855:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576640 00000100:00100000:1.0:1788460446.221873:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460446.221878:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482576640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460446.221894:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460446.221917:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482576640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460446.221922:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788460446.221933:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460446.222006:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576256 00000100:00100000:3.0:1788460446.222010:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576256 00000100:00100000:3.0:1788460446.222040:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788460446.222047:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482576256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460446.222077:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482576256:12345-0@lo:400:kworker.0 Request processed in 31us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460446.222082:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788460446.222169:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482576512:0@lo:400:kworker.0 00010000:00080000:2.0:1788460446.222211:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fded1f80 x1875336482576640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460446.222226:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482576640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460446.222332:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482576768:0@lo:400:kworker.0 00000100:00100000:0.0:1788460446.222341:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482576256:0@lo:400:kworker.0 00010000:00010000:3.0:1788460447.116726:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460448.141411:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460448.286112:0:11655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1788460448.824512:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1788460448.824524:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1788460448.824553:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788460448.824561:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1788460448.824767:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460448.824787:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482576896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788460448.824861:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460448.825209:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482576896 00000100:00100000:3.0:1788460448.825217:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482576896 00000100:00100000:3.0:1788460448.825272:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788460448.825282:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482576896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788460448.825316:0:8864:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788460448.825346:0:8864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a99bd9a, atime: 0x6a99bd9a, ctime: 0x6a99bd9a, blocks: 0x1 00010000:00010000:3.0:1788460448.825353:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.825369:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1788460448.825374:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460448.825380:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.825396:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.825429:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.825438:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.825454:0:8864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1788460448.825818:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460448.826328:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482576896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1047us (1466us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788460448.826338:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788460448.826395:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460448.826402:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.826413:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460448.826425:0:7659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.826435:0:7659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.826454:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.826460:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f208e0ea/0x889bb893541b7402 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460448.826486:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460448.826488:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460448.826490:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788460448.829375:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650fded1f80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788460448.829390:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482576896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788460449.003761:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460449.003795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460449.003819:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460449.003844:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460449.003864:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462619776 00000100:00100000:1.0:1788460449.003864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462619648 00000100:00100000:2.0:1788460449.003873:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462619776 00000100:00100000:1.0:1788460449.003873:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462619648 00000100:00100000:0.0:1788460449.003989:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462619904 00000100:00100000:0.0:1788460449.003995:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462619904 00000100:00100000:1.0:1788460449.003996:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1788460449.004020:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462619648:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460449.004095:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:1.0:1788460449.004099:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462619648:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460449.004103:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462619776:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460449.004106:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:2.0:1788460449.004128:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462619776:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460449.004128:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462619520 00000100:00100000:1.0:1788460449.004131:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462619520 00000100:00100000:2.0:1788460449.004134:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:1.0:1788460449.004151:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 275 00000100:00100000:1.0:1788460449.004158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462619520:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460449.004199:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462619520:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460449.004206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 275 00000100:00080000:3.0:1788460449.004649:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460449.004654:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460449.016367:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:1.0:1788460449.016386:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462619904:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460449.016543:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462619904:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 162us (12745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460449.016553:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00010000:00010000:0.0:1788460449.165094:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788460449.351114:0:11705:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe38638490 20000000:00000080:3.0:1788460449.351131:0:11705:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9650f5d54000 uarg=0000000000000000 20000000:01000000:3.0:1788460449.351164:0:11705:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788460449.351169:0:11705:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788460449.351174:0:11705:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788460449.353856:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788460449.354146:0:11705:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788460449.361507:0:11705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788460449.361564:0:11705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788460449.361616:0:11705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788460449.361633:0:11705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788460449.361652:0:11705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361670:0:11705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361679:0:11705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361687:0:11705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b72b2 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361695:0:11705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b72c0 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361713:0:11705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b72ce expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361721:0:11705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361759:0:11705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b72ce expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361774:0:11705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b72ce expref: 22 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.361788:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577024:0@lo:104: 00000100:00100000:3.0:1788460449.361847:0:11705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460449.361916:0:11705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b72c0 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361924:0:11705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b72c0 expref: 22 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.361933:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577152:0@lo:104: 00000100:00100000:3.0:1788460449.361954:0:11705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460449.361984:0:11705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b72b2 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.361991:0:11705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b72b2 expref: 22 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.361998:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577280:0@lo:104: 00000100:00100000:3.0:1788460449.362026:0:11705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460449.362045:0:11705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.362054:0:11705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 13 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.362063:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577408:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460449.362110:0:11705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.362118:0:11705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.362126:0:11705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577536:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460449.362145:0:11705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d169b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460449.362769:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482577024 00000100:00100000:2.0:1788460449.362778:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482577024 00000100:00100000:2.0:1788460449.362814:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482577152 00000100:00100000:2.0:1788460449.362818:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482577152 00000100:00100000:2.0:1788460449.362829:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482577280 00000100:00100000:2.0:1788460449.362831:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482577280 00000100:00100000:2.0:1788460449.362843:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460449.362851:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:11705:x1875336482577024:12345-0@lo:104: 00010000:00010000:2.0:1788460449.362865:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460449.362938:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460449.362944:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+5:11705:x1875336482577024:12345-0@lo:104: Request processed in 94us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460449.362962:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460449.362978:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460449.362984:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:11705:x1875336482577152:12345-0@lo:104: 00010000:00010000:2.0:1788460449.362992:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460449.363026:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460449.363031:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+4:11705:x1875336482577152:12345-0@lo:104: Request processed in 47us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460449.363036:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460449.363047:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460449.363053:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:11705:x1875336482577280:12345-0@lo:104: 00010000:00010000:2.0:1788460449.363060:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460449.363086:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788460449.363091:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+3:11705:x1875336482577280:12345-0@lo:104: Request processed in 39us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460449.363096:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788460449.363396:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577024:0@lo:104: 00000100:00100000:1.0:1788460449.363406:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577152:0@lo:104: 00000100:00100000:1.0:1788460449.363425:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577280:0@lo:104: 00010000:00010000:3.0:1788460449.363674:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788460449.363681:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363689:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460449.363693:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363702:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460449.363709:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460449.363727:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788460449.363756:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363763:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460449.363794:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363801:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4c00/0x889bb893541b72ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363814:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460449.363817:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363822:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460449.363825:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363832:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460449.363839:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460449.363843:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788460449.363856:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363861:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460449.363874:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363880:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc5e00/0x889bb893541b72c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363956:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460449.363960:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363965:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460449.363968:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.363974:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460449.363979:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460449.363984:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788460449.363999:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.364005:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460449.364020:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.364026:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b72b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b72b9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.364038:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460449.364045:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460449.364047:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460449.364053:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460449.364065:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482577792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460449.364115:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460449.364149:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788460449.364154:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482577664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460449.364173:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460449.364222:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482577920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460449.364240:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460449.364274:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482577792 00000100:00100000:3.0:1788460449.364279:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482577792 00010000:00010000:3.0:1788460449.364308:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b72c0 expref: 23 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.364326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482577664 00000100:00100000:3.0:1788460449.364329:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482577664 00010000:00010000:3.0:1788460449.364338:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b72ce expref: 24 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.364345:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482577920 00000100:00100000:3.0:1788460449.364357:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482577920 00010000:00010000:3.0:1788460449.364366:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b72b2 expref: 25 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.364377:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460449.364383:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+25:3319:x1875336482577792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460449.364392:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460449.364397:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b72c0 expref: 25 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.364410:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b72c0 expref: 25 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.364432:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009c00/0x889bb893541b72c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b72c0 expref: 25 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.364443:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460449.364471:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+24:3319:x1875336482577792:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460449.364477:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460449.364491:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788460449.365877:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482577664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460449.365906:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460449.365914:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b72ce expref: 23 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.365928:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b72ce expref: 23 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.365942:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102166400/0x889bb893541b72d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b72ce expref: 23 pid: 5836 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.365956:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460449.366002:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:3319:x1875336482577664:12345-0@lo:103:ldlm_bl.0 Request processed in 1506us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460449.366010:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788460449.366031:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788460449.366039:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:3316:x1875336482577920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460449.366058:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460449.366064:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b72b2 expref: 21 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.366073:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b72b2 expref: 21 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.366082:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5a00/0x889bb893541b72b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b72b2 expref: 21 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.366090:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460449.366119:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3316:x1875336482577920:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460449.366126:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788460449.366169:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482577664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460449.366199:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482577792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460449.367430:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577408:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460449.367523:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482577920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460449.367658:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460449.370933:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460449.371013:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620032 00000100:00100000:2.0:1788460449.371022:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620032 00010000:00010000:2.0:1788460449.371064:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 14 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460449.371103:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1788460449.371111:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462620032:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460449.371123:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460449.371139:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 14 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460449.371150:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 14 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460449.371167:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102166c00/0x889bb893541b72ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1239 expref: 14 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460449.371219:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460449.371273:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:2380:x1875336462620032:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 162us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460449.371280:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:1.0:1788460449.371548:0:11705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11705:1875336482577536:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460449.371586:0:11705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460449.373104:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460449.373312:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620160 00000100:00100000:3.0:1788460449.373320:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620160 00010000:00010000:3.0:1788460449.373352:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460449.373390:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1788460449.373399:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:2380:x1875336462620160:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460449.373421:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460449.373426:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373454:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373469:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102166200/0x889bb893541b72a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1232 expref: 13 pid: 5834 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373484:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373492:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373625:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373632:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373639:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373646:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373652:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460449.373656:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373663:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373690:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460449.373700:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460449.373749:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:2380:x1875336462620160:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 351us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460449.373757:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00010000:00010000:1.0:1788460449.373911:0:11705:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460449.373927:0:11705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460449.373932:0:11705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029cc00/0x889bb893541b7409 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460450.188486:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460450.927012:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460450.928625:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620288 00000100:00100000:1.0:1788460450.928638:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620288 00000100:00100000:1.0:1788460450.928711:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 276 00000100:00100000:1.0:1788460450.928722:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:5622:x1875336462620288:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460450.928738:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460450.928757:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166e600/0x889bb893541b7410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1286 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460450.928786:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166e600/0x889bb893541b7410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1286 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460450.928797:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166e600/0x889bb893541b7410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1286 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460450.928805:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166e600, rc 0) 00000100:00100000:1.0:1788460450.930004:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462620288:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 1278us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460450.930015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 276 00000100:00100000:0.0:1788460450.942035:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460450.942426:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620416 00000100:00100000:1.0:1788460450.942437:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620416 00000100:00100000:1.0:1788460450.942494:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 277 00000100:00100000:1.0:1788460450.942504:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462620416:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460450.943164:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462620416:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 659us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460450.943173:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 277 00000100:00100000:2.0:1788460450.950004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460450.950105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620544 00000100:00100000:1.0:1788460450.950114:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620544 00000100:00100000:1.0:1788460450.950167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 278 00000100:00100000:1.0:1788460450.950204:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462620544:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460450.950435:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8919850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462620544:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 259us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460450.950444:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 278 00000100:00100000:0.0:1788460450.953888:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460450.957781:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620672 00000100:00100000:1.0:1788460450.957795:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620672 00000100:00100000:1.0:1788460450.957868:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 279 00000100:00100000:1.0:1788460450.957877:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:9999:x1875336462620672:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460450.958123:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:9999:x1875336462620672:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 246us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460450.958131:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 279 00000100:00100000:0.0:1788460450.967746:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460450.967834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620800 00000100:00100000:1.0:1788460450.967844:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620800 00000100:00100000:1.0:1788460450.967904:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 280 00000100:00100000:1.0:1788460450.967913:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:9999:x1875336462620800:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460450.968158:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:9999:x1875336462620800:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 245us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460450.968166:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 280 00000100:00100000:2.0:1788460450.983672:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460450.983833:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462620928 00000100:00100000:3.0:1788460450.983895:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462620928 00000100:00100000:3.0:1788460450.983948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 281 00000100:00100000:3.0:1788460450.983958:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:5622:x1875336462620928:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460450.983975:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460450.983993:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d600/0x889bb893541b7417 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d128d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460450.984020:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d600/0x889bb893541b7417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d128d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460450.984031:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d600/0x889bb893541b7417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d128d expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460450.984055:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d600, rc 0) 00000100:00100000:3.0:1788460450.984114:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462620928:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 157us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460450.984121:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 281 00000100:00100000:0.0:1788460450.988126:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460450.988210:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621056 00000100:00100000:3.0:1788460450.988220:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621056 00000100:00100000:3.0:1788460450.988300:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 282 00000100:00100000:3.0:1788460450.988310:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462621056:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460450.988601:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462621056:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 292us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460450.988610:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 282 00000100:00100000:0.0:1788460451.001921:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460451.002291:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621184 00000100:00100000:1.0:1788460451.002301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621184 00000100:00100000:1.0:1788460451.002351:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 283 00000100:00100000:1.0:1788460451.002360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462621184:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.002587:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:5622:x1875336462621184:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 227us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.002595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 283 00000100:00100000:2.0:1788460451.017665:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460451.024347:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621312 00000100:00100000:1.0:1788460451.024362:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621312 00000100:00100000:1.0:1788460451.024440:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 284 00000100:00100000:1.0:1788460451.024450:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:10002:x1875336462621312:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460451.024710:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:10002:x1875336462621312:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 259us (7053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.024726:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 284 00000100:00100000:0.0:1788460451.029411:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460451.029500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621440 00000100:00100000:3.0:1788460451.029510:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621440 00000100:00100000:3.0:1788460451.029563:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 285 00000100:00100000:3.0:1788460451.029572:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:10002:x1875336462621440:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460451.029814:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:10002:x1875336462621440:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 243us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460451.029822:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 285 00010000:00010000:3.0:1788460451.214437:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460451.340593:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482578176:0@lo:400:kworker.0 00000100:00100000:1.0:1788460451.340631:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482578432:0@lo:400:kworker.0 00000100:00100000:2.0:1788460451.340709:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482578048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460451.340715:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482578304:0@lo:400:kworker.0 00000100:00100000:1.0:1788460451.341335:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460451.341393:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482578944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460451.341442:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788460451.341667:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460451.341671:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650efb15800 from 7 10000000:01000000:1.0:1788460451.341675:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460451.341705:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.341724:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.341755:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460451.341772:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.341820:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460451.341842:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460451.341860:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578432 00000100:00100000:1.0:1788460451.341866:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578432 00000100:00100000:1.0:1788460451.341928:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788460451.341937:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482578432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460451.341983:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482578432:12345-0@lo:400:kworker.0 Request processed in 47us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.341990:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788460451.342011:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578944 00000100:00100000:1.0:1788460451.342014:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578944 00000100:00100000:1.0:1788460451.342041:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460451.342047:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482578944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460451.342072:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460451.342111:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482578944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.342118:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788460451.342134:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460451.342138:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460451.342200:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482578944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460451.342213:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482578432:0@lo:400:kworker.0 00000100:00100000:0.0:1788460451.342241:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460451.342270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579072 00000100:00100000:1.0:1788460451.342275:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579072 00000100:00100000:0.0:1788460451.342279:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482578688:0@lo:400:kworker.0 00000100:00100000:1.0:1788460451.342302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578176 00000100:00100000:1.0:1788460451.342306:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578176 00000100:00100000:0.0:1788460451.342313:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460451.342321:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788460451.342329:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460451.342339:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460451.342353:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166ea00/0x889bb893541b7425 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b741e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460451.342365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00010000:00010000:1.0:1788460451.342374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166ea00/0x889bb893541b7425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b741e expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460451.342377:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:3318:x1875336482578176:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1788460451.342392:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166ea00/0x889bb893541b7425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b741e expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.342411:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166ea00, rc 0) 00000100:00100000:0.0:1788460451.342436:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:3318:x1875336482578176:12345-0@lo:400:kworker.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.342443:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788460451.342463:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.342471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788460451.342484:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482578176:0@lo:400:kworker.0 00000100:00100000:1.0:1788460451.342503:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578688 00000100:00100000:1.0:1788460451.342508:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578688 00000100:00100000:0.0:1788460451.342531:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.342545:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00010000:00010000:0.0:1788460451.342546:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460451.342554:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482578688:12345-0@lo:400:kworker.0 00010000:00010000:0.0:1788460451.342565:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460451.342596:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482578688:12345-0@lo:400:kworker.0 Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.342602:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788460451.342616:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460451.342656:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482578688:0@lo:400:kworker.0 00000040:00080000:0.0:1788460451.342985:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 7 count 7 00000100:00100000:2.0:1788460451.344926:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460451.344965:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482578560:0@lo:400:kworker.0 00000100:00100000:2.0:1788460451.344994:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460451.345058:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578560 00000100:00100000:2.0:1788460451.345064:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578560 00000100:00100000:2.0:1788460451.345124:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788460451.345132:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482578560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460451.345176:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482578560:12345-0@lo:400:kworker.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460451.345200:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788460451.345241:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460451.345319:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578048 00000100:00100000:1.0:1788460451.345324:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578048 00000100:00100000:1.0:1788460451.345355:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788460451.345362:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482578048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460451.345387:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460451.345443:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482578048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.345451:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788460451.345515:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fded3800 x1875336482578560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460451.345532:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482578560:0@lo:400:kworker.0 00010000:00080000:2.0:1788460451.345737:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb95f80 x1875336482578048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460451.345753:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482578048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460451.350656:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460451.350702:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482578816:0@lo:400:kworker.0 00000100:00100000:1.0:1788460451.350724:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578304 00000100:00100000:1.0:1788460451.350733:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578304 00000100:00100000:3.0:1788460451.350739:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460451.350805:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788460451.350817:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482578304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460451.350819:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482578816 00000100:00100000:2.0:1788460451.350826:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482578816 00000100:00100000:2.0:1788460451.350872:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788460451.350881:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482578304:12345-0@lo:400:kworker.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460451.350883:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482578816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460451.350903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788460451.350933:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482578816:12345-0@lo:400:kworker.0 Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460451.350941:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788460451.351048:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482578304:0@lo:400:kworker.0 00000100:00100000:3.0:1788460451.351064:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482578816:0@lo:400:kworker.0 00000040:00080000:0.0:1788460451.351232:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460451.351500:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788460451.351547:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788460451.351597:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788460451.351636:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788460451.351667:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788460451.351721:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788460451.351730:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 6 count 7 00000100:00100000:0.0:1788460451.351799:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.351834:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460451.351874:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460451.352859:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579200 00000100:00100000:1.0:1788460451.352868:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579200 00000100:00100000:1.0:1788460451.352925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788460451.352935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.353176:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.353212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788460451.353396:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.353444:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.353484:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460451.353612:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460451.357370:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579328 00000100:00100000:1.0:1788460451.357386:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579328 00000100:00100000:1.0:1788460451.357458:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788460451.357468:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460451.359209:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.359212:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1743us (5724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.359227:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000040:00080000:2.0:1788460451.360244:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460451.361451:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579456:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460451.361648:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460451.361816:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460451.368323:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579456 00000100:00100000:3.0:1788460451.368337:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579456 00000100:00100000:2.0:1788460451.368434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788460451.368445:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579456:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460451.368694:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579456:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 251us (7046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460451.368703:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788460451.368720:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579456:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460451.368965:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788460451.369019:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788460451.369083:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788460451.369126:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788460451.369154:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788460451.369216:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788460451.369253:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788460451.369287:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788460451.369324:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579584:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.369368:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460451.369415:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460451.369537:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579584 00000100:00100000:1.0:1788460451.369542:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579584 00000100:00100000:1.0:1788460451.369583:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788460451.369590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579584:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.369762:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579584:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 171us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.369769:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788460451.370071:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579584:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460451.370159:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788460451.370170:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788460451.372729:0:11718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460451.372744:0:11718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460451.372746:0:11718:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788460451.372753:0:11718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9650efb15800 00000020:00000080:0.0:1788460451.372756:0:11718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460451.372834:0:11718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460451.372838:0:11718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460451.372840:0:11718:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788460451.372843:0:11718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1788460451.373026:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788460451.373050:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460451.373062:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460451.373092:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460451.373107:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788460451.373109:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650f6139800 from 7 10000000:01000000:3.0:1788460451.373112:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460451.373145:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460451.373152:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460451.373163:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460451.373222:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460451.373281:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460451.373314:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d169b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460451.376248:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579712 00000100:00100000:1.0:1788460451.376263:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579712 00000100:00100000:1.0:1788460451.376324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788460451.376334:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:5839:x1875336482579712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460451.376351:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460451.376370:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c166e000/0x889bb893541b7433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b742c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.376397:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c166e000/0x889bb893541b7433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b742c expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.376419:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c166e000/0x889bb893541b7433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b742c expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.376428:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c166e000, rc 0) 00000100:00100000:1.0:1788460451.376499:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482579712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.376516:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788460451.382381:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460451.382419:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460451.382431:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460451.382838:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 7 count 7 00000040:00080000:2.0:1788460451.383647:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460451.383865:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788460451.383905:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:2.0:1788460451.383948:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:2.0:1788460451.383976:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:2.0:1788460451.383999:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:2.0:1788460451.384059:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:2.0:1788460451.384066:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 6 count 7 00000100:00100000:2.0:1788460451.384137:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460451.384226:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460451.384275:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460451.385989:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579840 00000100:00100000:0.0:1788460451.386001:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579840 00000100:00100000:0.0:1788460451.386046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788460451.386055:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482579840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.386346:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482579840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.386354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788460451.386415:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.386467:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.386510:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460451.386535:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482579968 00000100:00100000:0.0:1788460451.386544:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482579968 00000100:00100000:0.0:1788460451.386567:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788460451.386573:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482579968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.386701:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482579968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.386708:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788460451.386747:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460451.386759:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482579968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788460451.387281:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460451.387342:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580096:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.387383:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460451.387422:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580096 00000100:00100000:0.0:1788460451.387427:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580096 00000100:00100000:0.0:1788460451.387450:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788460451.387457:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482580096:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.387572:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482580096:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 115us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.387580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788460451.387617:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460451.387631:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580096:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460451.387827:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788460451.387870:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:0.0:1788460451.387923:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:0.0:1788460451.387958:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:0.0:1788460451.387989:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:0.0:1788460451.388039:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:0.0:1788460451.388088:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:0.0:1788460451.388120:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000100:00100000:0.0:1788460451.388143:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580224:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.388176:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460451.388222:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580224 00000100:00100000:0.0:1788460451.388226:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580224 00000100:00100000:0.0:1788460451.388249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788460451.388255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482580224:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.388369:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482580224:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 113us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.388376:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788460451.388421:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460451.388434:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580224:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460451.388501:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788460451.388511:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788460451.404071:0:11721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460451.404084:0:11721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460451.404086:0:11721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788460451.404093:0:11721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9650f6139800 00000020:00000080:3.0:1788460451.404095:0:11721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460451.404170:0:11721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460451.404174:0:11721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460451.404175:0:11721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788460451.404194:0:11721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000020:01000000:1.0:1788460451.404929:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788460451.404944:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460451.404956:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.404969:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460451.404980:0:5839:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460451.404982:0:5839:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5118800 from 7 10000000:01000000:1.0:1788460451.404984:0:5839:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460451.405018:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.405026:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.405036:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460451.405058:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.405120:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460451.405163:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460451.407001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580352 00000100:00100000:0.0:1788460451.407012:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580352 00000100:00100000:0.0:1788460451.407056:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788460451.407064:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:5839:x1875336482580352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460451.407078:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460451.407092:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650fcd5b400/0x889bb893541b7441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b743a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460451.407116:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650fcd5b400/0x889bb893541b7441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b743a expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460451.407127:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650fcd5b400/0x889bb893541b7441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b743a expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460451.407146:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b400, rc 0) 00000100:00100000:0.0:1788460451.407225:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482580352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.407232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788460451.408784:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460451.408805:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.408817:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460451.408869:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.408910:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460451.408949:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460451.409000:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580480 00000100:00100000:0.0:1788460451.409005:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580480 00000100:00100000:0.0:1788460451.409041:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788460451.409049:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482580480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460451.409537:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482580480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 487us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.409553:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788460451.423125:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d10d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460451.423826:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460451.423903:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460451.423948:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571c000 going to sleep for 11 seconds 00000040:00080000:0.0:1788460451.424622:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788460451.424794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580608 00000100:00100000:1.0:1788460451.424801:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580608 00000100:00100000:1.0:1788460451.424851:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788460451.424861:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482580608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460451.425062:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:5839:x1875336482580608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.425070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788460451.425235:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ce24ccd6-bef2-4d18-b934-4ac2305873bc:5839:1875336482580608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460451.428822:0:11723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:11723:1875336482580736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460451.428905:0:11723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460451.428951:0:11723:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d169b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788460451.432120:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580736 00000100:00100000:1.0:1788460451.432133:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580736 00000100:00100000:1.0:1788460451.432211:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788460451.432220:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:11723:x1875336482580736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460451.432466:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:11723:x1875336482580736:12345-0@lo:502:llog_process_th.0 Request processed in 246us (3560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460451.432475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788460451.433911:0:11723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:11723:1875336482580736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788460451.433953:0:11723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460451.433963:0:11723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460451.433965:0:11723:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788460451.433972:0:11723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9650c5118800 00000020:00000080:0.0:1788460451.433975:0:11723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788460451.434056:0:11723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:11723:1875336482580864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460451.434114:0:11723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460451.434167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580864 00000100:00100000:0.0:1788460451.434173:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580864 00000100:00100000:0.0:1788460451.434223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788460451.434230:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:11723:x1875336482580864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460451.434413:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:11723:x1875336482580864:12345-0@lo:502:llog_process_th.0 Request processed in 182us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460451.434427:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788460451.434467:0:11723:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460451.434479:0:11723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ce24ccd6-bef2-4d18-b934-4ac2305873bc:11723:1875336482580864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788460451.434501:0:11723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460451.434505:0:11723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460451.434506:0:11723:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788460451.434510:0:11723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788460451.434869:0:5839:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788460451.434877:0:5839:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460451.434886:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460451.434896:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460452.242032:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460452.428829:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788460453.262961:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788460453.961655:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1788460454.126412:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460454.126453:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460454.126484:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460454.126534:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460454.126567:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621696 00000100:00100000:2.0:1788460454.126576:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621696 00000100:00100000:2.0:1788460454.126633:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621952 00000100:00100000:2.0:1788460454.126636:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621952 00000100:00100000:2.0:1788460454.126657:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:2.0:1788460454.126666:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462621696:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460454.126745:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462621696:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460454.126753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:2.0:1788460454.126768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:2.0:1788460454.126774:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462621952:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460454.126797:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2380:x1875336462621952:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460454.126803:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00080000:2.0:1788460454.126819:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460454.127029:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621824 00000100:00100000:3.0:1788460454.127034:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621824 00000100:00100000:3.0:1788460454.127081:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1788460454.127088:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462621824:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460454.127118:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462621824:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460454.127124:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00080000:2.0:1788460454.127306:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460454.127502:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462621568 00000100:00100000:1.0:1788460454.127514:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462621568 00000100:00100000:1.0:1788460454.127547:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 302 00000100:00100000:1.0:1788460454.127555:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462621568:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460454.127582:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462621568:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460454.127589:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 302 00010000:00010000:0.0:1788460454.285660:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460455.310768:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460456.332522:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460456.460795:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482580992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460456.460879:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460456.461019:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482580992 00000100:00100000:2.0:1788460456.461026:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482580992 00000100:00100000:2.0:1788460456.461084:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788460456.461093:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482580992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460456.461126:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460456.461171:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482580992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460456.461199:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460456.461483:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482581248:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.461514:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460456.461537:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788460456.461543:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482581120:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.461570:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460456.461590:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482581632:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.461609:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460456.461636:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482581248 00000100:00100000:3.0:1788460456.461640:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482581248 00000100:00100000:3.0:1788460456.461668:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482581632 00000100:00100000:3.0:1788460456.461670:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482581632 00000100:00100000:3.0:1788460456.461692:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788460456.461699:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482581248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.461752:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482581248:12345-0@lo:400:kworker.0 Request processed in 53us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460456.461759:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788460456.461771:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788460456.461777:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482581632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.461800:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482581632:12345-0@lo:400:kworker.0 Request processed in 25us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460456.461805:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788460456.461842:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482581376:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.461865:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460456.461884:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460456.461889:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482581504:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.461913:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460456.461941:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482581504 00000100:00100000:3.0:1788460456.461945:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482581504 00000100:00100000:3.0:1788460456.461972:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788460456.461979:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482581504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.462012:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482581504:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460456.462018:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788460456.462054:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8c700 x1875336482581504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460456.462068:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482581504:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.462095:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482581632:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.462103:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482581248:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.462126:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482581376 00000100:00100000:3.0:1788460456.462129:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482581376 00000100:00100000:3.0:1788460456.462151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788460456.462157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482581376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.462225:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482581376:12345-0@lo:400:kworker.0 Request processed in 68us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460456.462232:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788460456.462461:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482581376:0@lo:400:kworker.0 00000100:00100000:1.0:1788460456.462654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482581120 00000100:00100000:1.0:1788460456.462659:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482581120 00000100:00100000:1.0:1788460456.462697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788460456.462704:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482581120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460456.462741:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482581120:12345-0@lo:400:kworker.0 Request processed in 38us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460456.462746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:1.0:1788460456.462770:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460456.462775:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460456.462777:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460456.462794:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788460456.462800:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650fded1f80, transno 4294967300 00000100:00100000:1.0:1788460456.462826:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482580992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460456.463237:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482581120:0@lo:400:kworker.0 00000100:00100000:3.0:1788460456.463886:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460456.463899:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482581760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460456.463942:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460456.464261:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482581760 00000100:00100000:0.0:1788460456.464267:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482581760 00000100:00100000:0.0:1788460456.464307:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788460456.464315:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482581760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460456.464341:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460456.464393:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482581760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460456.464399:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788460456.464603:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb94a80 x1875336482581760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460456.464620:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482581760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460457.356526:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460458.380650:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460459.247803:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460459.247854:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460459.247885:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460459.247922:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460459.247954:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622208 00000100:00100000:2.0:1788460459.247963:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622208 00000100:00100000:2.0:1788460459.248018:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622464 00000100:00100000:2.0:1788460459.248021:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622464 00000100:00100000:2.0:1788460459.248042:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:2.0:1788460459.248051:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462622208:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460459.248118:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462622208:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 68us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460459.248126:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:2.0:1788460459.248142:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:2.0:1788460459.248148:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462622464:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460459.248171:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462622464:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460459.248207:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00080000:2.0:1788460459.248419:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460459.248819:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622336 00000100:00100000:3.0:1788460459.248825:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622336 00000100:00100000:3.0:1788460459.248878:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:3.0:1788460459.248886:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462622336:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460459.248924:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462622336:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 38us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460459.248930:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00080000:2.0:1788460459.250944:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460459.253369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622080 00000100:00100000:0.0:1788460459.253383:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622080 00000100:00100000:0.0:1788460459.253453:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 304 00000100:00100000:0.0:1788460459.253462:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462622080:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460459.253544:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462622080:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 83us (5750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460459.253569:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 304 00010000:00010000:3.0:1788460459.407623:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460460.431749:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460461.452490:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460461.580492:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460461.580517:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482581888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460461.580588:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460461.580720:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482581888 00000100:00100000:0.0:1788460461.580729:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482581888 00000100:00100000:0.0:1788460461.580794:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788460461.580805:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482581888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460461.580839:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460461.580890:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482581888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460461.580897:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788460461.580939:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482581888:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788460461.581041:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460461.581699:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482582016:0@lo:400:kworker.0 00000100:00100000:1.0:1788460461.581902:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460461.581990:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582016 00000100:00100000:3.0:1788460461.581997:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582016 00000100:00100000:3.0:1788460461.582034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788460461.582043:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482582016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582215:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482582016:12345-0@lo:400:kworker.0 Request processed in 172us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460461.582222:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788460461.582279:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482582400:0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582308:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460461.582354:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582400 00000100:00100000:3.0:1788460461.582358:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582400 00000100:00100000:3.0:1788460461.582391:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460461.582398:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482582400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582433:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482582400:12345-0@lo:400:kworker.0 Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460461.582440:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788460461.582456:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788460461.582479:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108c380 x1875336482582400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460461.582492:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482582400:0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582519:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482582144:0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582546:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460461.582566:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460461.582571:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482582272:0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582592:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460461.582622:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582144 00000100:00100000:3.0:1788460461.582626:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582144 00000100:00100000:3.0:1788460461.582649:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582272 00000100:00100000:3.0:1788460461.582651:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582272 00000100:00100000:3.0:1788460461.582677:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788460461.582692:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482582144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582729:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482582144:12345-0@lo:400:kworker.0 Request processed in 39us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460461.582735:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788460461.582768:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788460461.582775:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482582272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582801:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482582272:12345-0@lo:400:kworker.0 Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460461.582807:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1788460461.582821:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460461.582837:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482582272:0@lo:400:kworker.0 00000100:00100000:3.0:1788460461.582846:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482582144:0@lo:400:kworker.0 00000100:00100000:1.0:1788460461.584126:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482582016:0@lo:400:kworker.0 00000100:00100000:1.0:1788460461.584164:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482582528:0@lo:400:kworker.0 00000100:00100000:1.0:1788460461.584230:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460461.584568:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582528 00000100:00100000:2.0:1788460461.584574:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582528 00000100:00100000:2.0:1788460461.584711:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788460461.584719:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482582528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460461.584736:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482582656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460461.584775:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482582528:12345-0@lo:400:kworker.0 Request processed in 56us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460461.584780:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460461.584796:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788460461.584820:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582656 00000100:00100000:0.0:1788460461.584824:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582656 00000100:00100000:0.0:1788460461.584857:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788460461.584865:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482582656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460461.584895:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788460461.584905:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460461.584947:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482582656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460461.584948:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482582528:0@lo:400:kworker.0 00000100:00100000:0.0:1788460461.584961:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788460461.585456:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb94700 x1875336482582656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460461.585473:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482582656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460462.476489:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460462.669334:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788460463.500323:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460464.362171:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460464.362249:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460464.362344:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622592 00000100:00100000:1.0:1788460464.362364:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622592 00000100:00100000:1.0:1788460464.362418:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 306 00000100:00100000:1.0:1788460464.362428:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462622592:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460464.362503:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462622592:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460464.362510:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 306 00000100:00100000:3.0:1788460464.362958:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622720 00000100:00100000:3.0:1788460464.362963:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622720 00000100:00100000:3.0:1788460464.363016:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:3.0:1788460464.363023:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462622720:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460464.363067:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462622720:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 44us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460464.363074:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00080000:1.0:1788460464.363241:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460464.377481:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460464.377527:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460464.377613:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622976 00000100:00100000:0.0:1788460464.377622:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622976 00000100:00100000:0.0:1788460464.377692:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:0.0:1788460464.377714:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462622976:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460464.377783:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462622976:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460464.377791:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00080000:1.0:1788460464.378104:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460464.378247:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462622848 00000100:00100000:3.0:1788460464.378252:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462622848 00000100:00100000:3.0:1788460464.378299:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1788460464.378307:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2378:x1875336462622848:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:3.0:1788460464.378337:0:8864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b737d 00000100:00080000:3.0:1788460464.378353:0:8864:0:(import.c:65:import_set_state_nolock()) ffff9650fcac7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460464.378396:0:8864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1788460464.378654:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788460464.378744:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460464.379137:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+2:2378:x1875336462622848:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 828us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460464.379147:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00010000:00010000:0.0:1788460464.524903:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460465.548411:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460466.572601:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460466.700451:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460466.700476:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482582784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460466.700521:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482583296:0@lo:400:kworker.0 00000100:00100000:2.0:1788460466.700548:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460466.700564:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460466.700615:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482583168:0@lo:400:kworker.0 00000100:00100000:2.0:1788460466.700640:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460466.700676:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582784 00000100:00100000:2.0:1788460466.700683:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582784 00000100:00100000:2.0:1788460466.700733:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788460466.700742:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482582784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460466.700774:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460466.700814:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482582784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460466.700821:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788460466.700843:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583168 00000100:00100000:2.0:1788460466.700847:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583168 00000100:00100000:2.0:1788460466.700871:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788460466.700877:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482583168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460466.700921:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482583168:12345-0@lo:400:kworker.0 Request processed in 44us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460466.700927:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788460466.700961:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482583168:0@lo:400:kworker.0 00010000:00080000:2.0:1788460466.700972:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efb97b80 x1875336482582784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460466.700986:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efb97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482582784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460466.701036:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583296 00000100:00100000:2.0:1788460466.701040:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583296 00000100:00100000:2.0:1788460466.701064:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788460466.701071:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482583296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460466.701100:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482583296:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460466.701106:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788460466.701536:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482582912:0@lo:400:kworker.0 00000100:00100000:0.0:1788460466.701573:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460466.701607:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482583424:0@lo:400:kworker.0 00000100:00100000:0.0:1788460466.701629:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460466.701648:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788460466.701654:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482583040:0@lo:400:kworker.0 00000100:00100000:0.0:1788460466.701675:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460466.701692:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff964fc2d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482583552:0@lo:400:kworker.0 00010000:00080000:3.0:1788460466.701714:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650c75c9500 x1875336482583296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460466.701725:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460466.701734:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482583296:0@lo:400:kworker.0 00000100:00100000:3.0:1788460466.701753:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788460466.701761:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482583680:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788460466.701763:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460466.701770:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460466.701772:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583424 00000100:00100000:0.0:1788460466.701777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583424 00000100:00100000:3.0:1788460466.701792:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460466.701805:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583040 00000100:00100000:1.0:1788460466.701811:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583040 00000100:00100000:0.0:1788460466.701826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788460466.701848:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788460466.701858:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482583040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460466.701873:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482582912 00000100:00100000:2.0:1788460466.701878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482582912 00000100:00100000:1.0:1788460466.701905:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482583040:12345-0@lo:400:kworker.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460466.701908:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583680 00000100:00100000:2.0:1788460466.701912:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788460466.701915:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583680 00000100:00100000:1.0:1788460466.701916:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788460466.701925:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482582912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460466.701953:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788460466.701961:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583552 00000100:00100000:3.0:1788460466.701963:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482583680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460466.701968:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482582912:12345-0@lo:400:kworker.0 Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460466.701975:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583552 00000100:00100000:2.0:1788460466.701979:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00002000:00000024:3.0:1788460466.701991:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460466.702011:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460466.702021:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482583552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460466.702038:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482583680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460466.702045:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788460466.702063:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482583552:12345-0@lo:400:kworker.0 Request processed in 44us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460466.702071:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788460466.702083:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482583680:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788460466.702091:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460466.702095:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460466.702130:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482583040:0@lo:400:kworker.0 00000100:00100000:1.0:1788460466.702139:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff964fc2d7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482583552:0@lo:400:kworker.0 00000100:00100000:1.0:1788460466.702147:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482582912:0@lo:400:kworker.0 00000100:00100000:0.0:1788460466.702530:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482583424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460466.702579:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482583424:12345-0@lo:400:kworker.0 Request processed in 746us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460466.702587:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788460466.703490:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482583424:0@lo:400:kworker.0 00010000:00010000:0.0:1788460467.596581:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460468.621569:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788460469.362649:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:1.0:1788460469.362658:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650fcac0000/9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:3.0:1788460469.362785:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fcac0000/9e69358b-6b5d-4a87-b6fb-534c610a3920 for lustre-OST0001 00000020:00000080:3.0:1788460469.362839:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fcac7800 for lustre-OST0001 00000100:00100000:2.0:1788460469.481340:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460469.481390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460469.481437:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460469.481583:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462623104 00000100:00100000:3.0:1788460469.481610:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462623104 00000100:00100000:0.0:1788460469.481646:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462623232 00000100:00100000:0.0:1788460469.481659:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462623232 00000100:00100000:3.0:1788460469.481669:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 308 00000100:00100000:3.0:1788460469.481681:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462623104:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460469.481706:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462623360 00000100:00100000:0.0:1788460469.481710:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462623360 00000100:00100000:0.0:1788460469.481734:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1788460469.481744:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462623232:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460469.481766:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462623104:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 87us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460469.481775:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 308 00000100:00100000:0.0:1788460469.481787:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462623232:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 44us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460469.481794:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1788460469.481812:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:0.0:1788460469.481817:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462623360:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:3.0:1788460469.481826:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460469.481842:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462623360:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460469.481849:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00010000:00010000:0.0:1788460469.644763:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460470.679721:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460471.692440:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460471.820528:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460471.820550:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482583808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460471.820612:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460471.820726:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583808 00000100:00100000:1.0:1788460471.820735:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583808 00000100:00100000:1.0:1788460471.820797:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788460471.820807:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482583808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460471.820842:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460471.820885:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482583808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460471.820904:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788460471.820971:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460471.821005:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482583808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460471.821995:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482584192:0@lo:400:kworker.0 00000100:00100000:2.0:1788460471.822043:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460471.822086:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460471.822092:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482584320:0@lo:400:kworker.0 00000100:00100000:2.0:1788460471.822116:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460471.822151:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482584320 00000100:00100000:2.0:1788460471.822156:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482584320 00000100:00100000:2.0:1788460471.822216:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788460471.822225:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482584320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460471.822277:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482584320:12345-0@lo:400:kworker.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460471.822284:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788460471.822304:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788460471.822327:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fcdc6680 x1875336482584320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460471.822339:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482584320:0@lo:400:kworker.0 00000100:00100000:1.0:1788460471.822535:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482583936:0@lo:400:kworker.0 00000100:00100000:1.0:1788460471.822568:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460471.822596:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482584448:0@lo:400:kworker.0 00000100:00100000:1.0:1788460471.822628:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460471.822655:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788460471.822661:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482584064:0@lo:400:kworker.0 00000100:00100000:1.0:1788460471.822682:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460471.822698:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482584576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460471.822739:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460471.822769:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482584576 00000100:00100000:1.0:1788460471.822774:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482584576 00000100:00100000:1.0:1788460471.822800:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788460471.822807:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482584576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460471.822831:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460471.822865:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482584576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460471.822871:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788460471.822914:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3d1880 x1875336482584576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460471.822930:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482584576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460471.823000:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482584192 00000100:00100000:0.0:1788460471.823005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482584192 00000100:00100000:0.0:1788460471.823046:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482584448 00000100:00100000:0.0:1788460471.823049:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482584448 00000100:00100000:0.0:1788460471.823062:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482584064 00000100:00100000:0.0:1788460471.823065:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482584064 00000100:00100000:0.0:1788460471.823077:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788460471.823084:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482584192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460471.823128:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482584192:12345-0@lo:400:kworker.0 Request processed in 44us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460471.823135:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788460471.823149:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788460471.823155:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482584448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460471.823211:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482584448:12345-0@lo:400:kworker.0 Request processed in 56us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460471.823217:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788460471.823229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788460471.823234:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482584064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460471.823272:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482584064:12345-0@lo:400:kworker.0 Request processed in 37us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460471.823281:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788460471.823314:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482584064:0@lo:400:kworker.0 00000100:00100000:0.0:1788460471.823324:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482584448:0@lo:400:kworker.0 00000100:00100000:2.0:1788460471.823609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482583936 00000100:00100000:2.0:1788460471.823614:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482583936 00000100:00100000:2.0:1788460471.823645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788460471.823651:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482583936:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788460471.823807:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460471.823851:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482583936:12345-0@lo:400:kworker.0 Request processed in 200us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460471.823858:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788460471.823995:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482584192:0@lo:400:kworker.0 00000100:00100000:0.0:1788460471.825307:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482583936:0@lo:400:kworker.0 00010000:00010000:2.0:1788460472.718079:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460472.909643:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788460472.961356:0:11890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:34:30 (1788460470) 00010000:00010000:0.0:1788460473.741680:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460474.608893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460474.609276:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460474.609328:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460474.609420:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462623744 00000100:00100000:0.0:1788460474.609441:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462623744 00000100:00100000:0.0:1788460474.609501:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462623616 00000100:00100000:0.0:1788460474.609505:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462623616 00000100:00100000:0.0:1788460474.609528:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1788460474.609538:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462623744:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460474.609607:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462623744:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460474.609627:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1788460474.609647:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:0.0:1788460474.609654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462623616:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460474.609684:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462623616:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460474.609690:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00080000:2.0:1788460474.609757:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460474.609923:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462623488 00000100:00100000:1.0:1788460474.609928:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462623488 00000100:00100000:1.0:1788460474.610000:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 310 00000100:00100000:1.0:1788460474.610007:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462623488:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460474.610046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462623488:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 39us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460474.610053:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 310 00000100:00100000:2.0:1788460474.668282:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460474.668706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462623872 00000100:00100000:0.0:1788460474.668716:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462623872 00000100:00100000:0.0:1788460474.669106:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1788460474.669222:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:10274:x1875336462623872:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460474.669255:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460474.669318:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1294 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.669382:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b744f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.669397:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b744f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.669408:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b744f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460474.669441:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788460474.669445:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460474.669482:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b744f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.669525:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1294 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.669551:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b744f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1294 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.669560:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:0.0:1788460474.669563:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460474.669567:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b800, rc 0) 00000100:00100000:0.0:1788460474.669632:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:10274:x1875336462623872:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 517us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460474.669638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1788460474.686880:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460474.688168:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462624000 00000100:00100000:1.0:1788460474.688222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462624000 00000100:00100000:1.0:1788460474.688309:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:1.0:1788460474.688319:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:10275:x1875336462624000:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460474.688341:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460474.688363:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c0030a00/0x889bb893541b7456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d129b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688433:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688449:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688461:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688477:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688484:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688492:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688902:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b746b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688913:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b746b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688931:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b746b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460474.688959:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788460474.688963:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460474.688982:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b746b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688992:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.688999:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689005:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689011:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460474.689015:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689022:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689738:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:1.0:1788460474.689745:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460474.689751:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689760:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b745d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689792:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689798:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689805:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689810:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460474.689813:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689820:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689829:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9650c34d0e00) 00010000:00010000:1.0:1788460474.689832:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460474.689834:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689840:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7464 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689878:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c0030a00/0x889bb893541b7456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d129b expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689894:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b746b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d129b expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460474.689912:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650c34d0c00) 00010000:00010000:1.0:1788460474.689914:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460474.689917:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4c00, rc 0) 00000100:00100000:1.0:1788460474.689990:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:10275:x1875336462624000:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1672us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460474.689998:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1788460474.696458:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460474.696937:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462624256 00000100:00100000:0.0:1788460474.696948:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462624256 00000100:00100000:0.0:1788460474.697007:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1788460474.697017:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:10275:x1875336462624256:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460474.697039:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460474.697058:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7472 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12a2 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.697129:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.697143:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.697172:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.697267:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.697276:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.697284:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698044:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5be00/0x889bb893541b7487 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698058:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5be00/0x889bb893541b7487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698066:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5be00/0x889bb893541b7487 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460474.698077:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788460474.698421:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698430:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698438:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698443:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460474.698455:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698462:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698474:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650c34d0c00) 00010000:00010000:0.0:1788460474.698477:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460474.698482:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698488:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7479 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698499:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698504:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698510:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698515:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5bc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460474.698518:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698524:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698531:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9650d2c3c700) 00010000:00010000:0.0:1788460474.698533:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460474.698540:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.698546:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7480 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.699836:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7472 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12a2 expref: 10 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.699857:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5be00/0x889bb893541b7487 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12a2 expref: 9 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460474.699864:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:0.0:1788460474.699867:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460474.699870:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5be00, rc 0) 00000100:00100000:0.0:1788460474.699953:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10275:x1875336462624256:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2936us (3503us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788460474.699962:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1788460474.704598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460474.704655:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462624384 00000100:00100000:3.0:1788460474.704664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462624384 00000100:00100000:3.0:1788460474.704720:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1788460474.704730:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10275:x1875336462624384:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788460474.705654:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10275:x1875336462624384:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 921us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460474.705666:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00010000:00010000:3.0:1788460474.766519:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460474.956831:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788460475.792075:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460476.469917:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460476.470005:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462624512 00000100:00100000:3.0:1788460476.470015:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462624512 00000100:00100000:3.0:1788460476.470095:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:3.0:1788460476.470105:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10317:x1875336462624512:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460476.470124:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460476.470144:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b7495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12a9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470221:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470252:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470264:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470278:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470285:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470291:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470470:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470478:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470484:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470489:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460476.470493:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470500:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470511:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:3.0:1788460476.470519:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460476.470524:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470529:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b749c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470540:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470546:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470552:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470557:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029da00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460476.470560:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470565:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470572:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9650c52ed700) 00010000:00010000:3.0:1788460476.470574:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460476.470577:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470583:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b74a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470613:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b7495 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12a9 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470632:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:3.0:1788460476.470634:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460476.470637:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b7495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12a9 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.470646:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029ca00, rc 0) 00000100:00100000:3.0:1788460476.470702:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10317:x1875336462624512:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 599us (797us total) trans 0 rc 301/301 00000100:00100000:3.0:1788460476.470710:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00080000:1.0:1788460476.470937:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460476.487292:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460476.487482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462624768 00000100:00100000:1.0:1788460476.487494:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462624768 00000100:00100000:1.0:1788460476.487540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:1.0:1788460476.487549:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10317:x1875336462624768:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:1.0:1788460476.487600:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460476.487626:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b744f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1294 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.487645:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c500) 00010000:00010000:1.0:1788460476.487663:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460476.487851:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.487864:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.487874:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.487899:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.487907:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.487914:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460476.489424:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788460476.489438:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.489448:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.489455:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.489461:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460476.489465:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.489473:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.489485:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460476.489487:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460476.489491:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.489508:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b74aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460476.489528:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d23d2f5 reply state 00000000c81ba47b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460476.489537:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460476.489680:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:10317:x1875336462624768:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 2128us (2392us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788460476.489688:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00010000:00010000:0.0:1788460476.494871:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.494889:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.494897:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.494904:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460476.494909:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.494926:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.494941:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9650c34d0500) 00010000:00010000:0.0:1788460476.494944:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460476.494949:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.494956:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b74b1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460476.560073:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460476.560367:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462624896 00000100:00100000:0.0:1788460476.560377:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462624896 00000100:00100000:0.0:1788460476.560436:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:0.0:1788460476.560447:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10325:x1875336462624896:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:0.0:1788460476.560498:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460476.560531:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b74b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12b0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.560594:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b74bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.560608:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b74bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.560620:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b74bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460476.560666:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788460476.560682:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460476.560721:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b74bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.560743:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b74b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12b0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.560756:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b74bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12b0 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.560762:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:0.0:1788460476.560764:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460476.560767:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b000, rc 0) 00000100:00100000:0.0:1788460476.560817:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:10325:x1875336462624896:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 373us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460476.560822:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:3.0:1788460476.616065:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460476.616239:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462625024 00000100:00100000:0.0:1788460476.616250:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462625024 00000100:00100000:0.0:1788460476.616327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:0.0:1788460476.616338:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:10331:x1875336462625024:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460476.616359:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460476.616380:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b74c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12b7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616447:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616462:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616492:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616509:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616517:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616524:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616617:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b74db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616625:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b74db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616632:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b74db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460476.616660:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788460476.616665:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460476.616701:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b74db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616713:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616719:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616736:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616742:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460476.616746:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616754:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616766:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:0.0:1788460476.616769:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460476.616773:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616778:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b74cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616793:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616798:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616803:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616808:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460476.616810:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616825:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616833:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9650d2c3c900) 00010000:00010000:0.0:1788460476.616835:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460476.616837:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616843:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b74d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616874:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b74c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12b7 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616887:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b74db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12b7 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.616893:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460476.616895:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788460476.616897:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5ae00, rc 0) 00000100:00100000:0.0:1788460476.616963:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:10331:x1875336462625024:12345-192.168.203.32@tcp:101:bash.0 Request processed in 627us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460476.616970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:1.0:1788460476.621237:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460476.621440:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462625280 00000100:00100000:0.0:1788460476.621451:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462625280 00000100:00100000:0.0:1788460476.621507:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:0.0:1788460476.621518:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:10331:x1875336462625280:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460476.621553:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460476.621573:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b74e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12be expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.621696:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.621710:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.621723:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.621793:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.621801:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.621807:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788460476.622597:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788460476.622768:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622779:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622788:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622834:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622841:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622848:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622854:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460476.622858:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622866:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622878:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460476.622882:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460476.622887:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622894:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b74e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460476.622908:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3d950e8 reply state 00000000a649ff48 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460476.622916:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788460476.622944:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b74e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622970:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.622978:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:0.0:1788460476.622980:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460476.622983:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5ac00, rc 0) 00000100:00100000:0.0:1788460476.623107:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:10331:x1875336462625280:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1590us (1888us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788460476.623115:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00010000:00010000:0.0:1788460476.625136:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.625150:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.625157:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.625164:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460476.625167:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.625174:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.625235:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650d2c3ca00) 00010000:00010000:0.0:1788460476.625238:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460476.625246:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.625280:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b74f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460476.627431:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.627566:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462625408 00000100:00100000:2.0:1788460476.627577:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462625408 00000100:00100000:2.0:1788460476.627617:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1788460476.627625:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2378:x1875336462625408:12345-192.168.203.32@tcp:8:bash.0 00010000:00080000:2.0:1788460476.627661:0:8864:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from 9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:2.0:1788460476.627690:0:8864:0:(genops.c:1385:class_connect()) connect: client 9e69358b-6b5d-4a87-b6fb-534c610a3920, cookie 0x889bb893541b7505 00002000:00100000:2.0:1788460476.627701:0:8864:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9e69358b-6b5d-4a87-b6fb-534c610a3920/ffff9650fd268800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788460476.627723:0:8864:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788460476.628759:0:8864:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788460476.628795:0:8864:0:(import.c:65:import_set_state_nolock()) ffff9650fd269800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460476.628927:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2378:x1875336462625408:12345-192.168.203.32@tcp:8:bash.0 Request processed in 1300us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460476.628937:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1788460476.630768:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.630846:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462625536 00000100:00100000:2.0:1788460476.630855:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462625536 00000100:00100000:2.0:1788460476.630964:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1788460476.630974:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:0:x1875336462625536:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460476.630990:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460476.631012:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12c5 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460476.631055:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460476.631074:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788460476.631078:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460476.631088:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.631117:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.631129:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008200, rc 0) 00000100:00100000:2.0:1788460476.631201:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:0:x1875336462625536:12345-192.168.203.32@tcp:101:bash.0 Request processed in 230us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460476.631206:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00080000:1.0:1788460476.631433:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460476.633756:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460476.633845:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462625664 00000100:00100000:1.0:1788460476.633855:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462625664 00000100:00100000:1.0:1788460476.633956:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1788460476.633967:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:10331:x1875336462625664:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460476.633986:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460476.634005:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12cc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.634033:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.634042:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460476.634046:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460476.634052:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.634097:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.634121:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 8 pid: 6701 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460476.634134:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5007800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1875336482584704:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460476.634253:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460476.637239:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460476.637374:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462625792 00000100:00100000:3.0:1788460476.637384:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462625792 00010000:00010000:3.0:1788460476.637422:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 9 pid: 6701 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460476.637467:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1788460476.637478:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ea550450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2379:x1875336462625792:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460476.637493:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460476.637515:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 9 pid: 6701 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.637529:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 9 pid: 6701 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.637568:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460476.637573:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460476.637581:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.637590:0:7669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.637628:0:7669:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460476.637642:0:7669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7669:1875336482584832:192.168.203.32@tcp:105: 00000100:00100000:3.0:1788460476.637724:0:7669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5780 going to sleep for 11 seconds 00010000:00010000:1.0:1788460476.638324:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000598d07e2/0x889bb893541b750c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12c5 expref: 9 pid: 6701 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460476.638341:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5007800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1875336482584704:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460476.638366:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.638376:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4000, rc 0) 00000100:00100000:1.0:1788460476.638418:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:10331:x1875336462625664:12345-192.168.203.32@tcp:101:bash.0 Request processed in 4453us (4669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460476.638425:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:0.0:1788460476.642918:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460476.643022:0:7669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7669:1875336482584832:192.168.203.32@tcp:105: 00010000:00010000:3.0:1788460476.643047:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460476.643113:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ea550450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462625792:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 5628us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460476.643124:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:2.0:1788460476.643860:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462626048 00000100:00100000:2.0:1788460476.643868:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462626048 00000100:00100000:2.0:1788460476.643949:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1788460476.643959:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:10331:x1875336462626048:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:2.0:1788460476.644617:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:10331:x1875336462626048:12345-192.168.203.32@tcp:35:bash.0 Request processed in 656us (1705us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788460476.644626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1788460476.717296:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460476.717366:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462626304 00000100:00100000:1.0:1788460476.717376:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462626304 00000100:00100000:1.0:1788460476.717430:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:1.0:1788460476.717440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:10341:x1875336462626304:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460476.717481:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460476.717503:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b751a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12d3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460476.717588:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788460476.717856:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b751a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12d3 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.717869:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:1.0:1788460476.717941:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460476.717949:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b751a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12d3 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.717965:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5800, rc 0) 00000100:00100000:1.0:1788460476.718073:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:10341:x1875336462626304:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 633us (786us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788460476.718080:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:0.0:1788460476.720753:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460476.720896:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462626560 00000100:00100000:1.0:1788460476.720907:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462626560 00000100:00100000:1.0:1788460476.721020:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1788460476.721041:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:10341:x1875336462626560:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460476.721401:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:10341:x1875336462626560:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 370us (655us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788460476.721408:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:0.0:1788460476.797916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.798518:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462626688 00000100:00100000:2.0:1788460476.798529:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462626688 00000100:00100000:2.0:1788460476.798629:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:2.0:1788460476.798640:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:10347:x1875336462626688:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460476.798681:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460476.798700:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12da expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.798763:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b752f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.798778:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b752f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.798791:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b752f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460476.798825:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788460476.798829:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460476.798849:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b752f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.798874:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12da expref: 18 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.798891:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b752f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12da expref: 17 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.798900:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:2.0:1788460476.798903:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460476.798906:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008a00, rc 0) 00000100:00100000:2.0:1788460476.798971:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:10347:x1875336462626688:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 333us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460476.798978:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1788460476.804522:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460476.804843:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462626944 00000100:00100000:3.0:1788460476.804854:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462626944 00000100:00100000:3.0:1788460476.804950:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1788460476.804960:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:10347:x1875336462626944:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460476.804980:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460476.804998:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b7536 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.805119:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b753d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.805133:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b753d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.805146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b753d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460476.805157:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788460476.805319:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b7536 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12e1 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.805337:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b753d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12e1 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.805347:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:3.0:1788460476.805349:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460476.805353:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029da00, rc 0) 00000100:00100000:3.0:1788460476.805413:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:10347:x1875336462626944:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 454us (900us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788460476.805419:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1788460476.808293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460476.808459:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462627072 00000100:00100000:0.0:1788460476.808468:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462627072 00000100:00100000:0.0:1788460476.808531:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1788460476.808540:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:2382:x1875336462627072:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460476.808554:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460476.808576:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b753d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12e1 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.808596:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:0.0:1788460476.808600:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460476.808670:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:2382:x1875336462627072:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 130us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460476.808677:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1788460476.810703:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460476.810809:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462627328 00000100:00100000:3.0:1788460476.810818:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462627328 00000100:00100000:3.0:1788460476.810872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1788460476.810881:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:10347:x1875336462627328:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460476.810918:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460476.810936:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b754b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12e8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.811040:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7552 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.811055:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7552 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.811066:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7552 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460476.811079:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788460476.811248:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b754b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12e8 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.811484:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7552 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12e8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.811495:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:3.0:1788460476.811498:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788460476.811501:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c600, rc 0) 00000100:00100000:3.0:1788460476.811554:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:10347:x1875336462627328:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 675us (858us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788460476.811562:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00010000:00010000:2.0:1788460476.812294:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460476.819585:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.819720:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462627456 00000100:00100000:2.0:1788460476.819729:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462627456 00000100:00100000:2.0:1788460476.819791:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1788460476.819801:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462627456:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:2.0:1788460476.819845:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.819871:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.819880:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788460476.819884:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460476.819888:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.819924:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.819937:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 7 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460476.819952:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875336482584960:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460476.820060:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d831a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460476.822879:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875336482584960:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460476.822910:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460476.823896:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.824475:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462627584 00000100:00100000:2.0:1788460476.824485:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462627584 00002000:00100000:2.0:1788460476.824530:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9650c5007b80 x1875336462627584/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:632/0 lens 504/0 e 0 to 0 dl 1788460487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460476.824540:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650c5007b80 with x1875336462627584 ext(0->12) 00010000:00010000:2.0:1788460476.824550:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 8 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.824565:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 8 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460476.824572:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650c5007b80 00000100:00100000:2.0:1788460476.824607:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1788460476.824617:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462627584:12345-192.168.203.32@tcp:4:lfs.0 00000001:00100000:0.0:1788460476.856949:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000100:00100000:2.0:1788460476.858597:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2379:x1875336462627584:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 33973us (34697us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788460476.858612:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00002000:00100000:2.0:1788460476.858626:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9650c5007b80 x1875336462627584/t4294967299(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:632/0 lens 504/448 e 0 to 0 dl 1788460487 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460476.858761:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650c5007b80 with x1875336462627584 ext(0->12) 00010000:00010000:2.0:1788460476.858772:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.858806:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460476.858815:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650c5007b80 00000100:00100000:0.0:1788460476.862883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.862968:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462627712 00000100:00100000:2.0:1788460476.862977:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462627712 00010000:00010000:2.0:1788460476.863016:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460476.863368:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:2.0:1788460476.863380:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2381:x1875336462627712:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460476.863394:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788460476.863412:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788460476.863414:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788460475 00002000:00010000:2.0:1788460476.863416:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788460475 00002000:00010000:2.0:1788460476.863417:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788460475 00010000:00010000:2.0:1788460476.863422:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.863432:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.863449:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7513 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12cc expref: 9 pid: 6700 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.863471:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460476.863475:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460476.863479:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.863485:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.863539:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460476.863579:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462627712:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 202us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460476.863587:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00010000:00010000:0.0:1788460476.863624:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864601:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864726:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864735:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864742:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864748:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460476.864753:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864761:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864780:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.864787:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c020989/0x889bb893541b7560 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460476.864864:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462627456:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 45064us (45288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460476.864873:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1788460476.868824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.868918:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462627968 00000100:00100000:2.0:1788460476.868928:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462627968 00000100:00100000:2.0:1788460476.869028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460476.869047:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:10347:x1875336462627968:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:2.0:1788460476.869122:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7552 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12e8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460476.869561:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788460476.869619:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788460476.870874:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788460476.870939:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.870953:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.870964:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.870996:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.871010:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 24 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460476.871024:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875336482585088:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460476.871426:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d831a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460476.874099:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460476.874766:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875336482585088:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460476.874794:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460476.875540:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462628096 00000100:00100000:2.0:1788460476.875548:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462628096 00010000:00010000:2.0:1788460476.875584:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 25 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460476.875624:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:2.0:1788460476.875642:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+25:2380:x1875336462628096:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460476.875663:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460476.875670:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 25 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.875701:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 25 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.875734:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b74f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12be expref: 25 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.875750:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:2.0:1788460476.875755:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.875763:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.875771:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460476.875803:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460476.875862:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:2380:x1875336462628096:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 230us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460476.875869:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00010000:00010000:3.0:1788460476.875997:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.876005:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460476.876128:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788460476.877481:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788460476.877615:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482585216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788460476.877721:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460476.877756:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788460476.877880:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482585216 00000100:00100000:1.0:1788460476.877887:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482585216 00000100:00100000:1.0:1788460476.877948:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460476.877957:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875336482585216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788460476.878048:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875336482585216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460476.878056:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460476.878247:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482585216:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1788460476.878440:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788460476.878851:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788460476.878912:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482585344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460476.878950:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460476.879061:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d831a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460476.879516:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482585344 00000100:00100000:1.0:1788460476.879522:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482585344 00000100:00100000:1.0:1788460476.879553:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460476.879561:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875336482585344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460476.880216:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482585344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788460476.880283:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788460476.880324:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.880336:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.880343:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.880349:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460476.880353:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.880360:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.880387:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:0.0:1788460476.880390:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788460476.880395:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460476.880401:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7567 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788460476.880580:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1788460476.880746:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875336482585344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 439us (1049us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788460476.880757:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1788460476.880987:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788460476.880999:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350116819191ns, next at 351116816916ns, rc = 0 00000001:00080000:0.0:1788460476.881375:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788460476.881421:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:0.0:1788460476.881425:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788460476.881433:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7552 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12e8 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460476.881846:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:10347:x1875336462627968:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 12799us (13028us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788460476.881862:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000020:00080000:0.0:1788460476.881866:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788460476.890454:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460476.890642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462628224 00000100:00100000:1.0:1788460476.890661:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462628224 00000100:00100000:1.0:1788460476.890719:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:1.0:1788460476.890731:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:10347:x1875336462628224:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460476.891568:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460476.891606:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b756e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12ef expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.891669:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b756e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12ef expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.891685:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b756e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12ef expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460476.891718:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460476.891721:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460476.891725:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5000, rc 0) 00000100:00100000:1.0:1788460476.891785:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:10347:x1875336462628224:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1056us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460476.891792:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1788460476.901454:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460476.903029:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462628480 00000100:00100000:1.0:1788460476.903043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462628480 00000100:00100000:1.0:1788460476.903120:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1788460476.903130:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c802e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:10347:x1875336462628480:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460476.903413:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c802e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:10347:x1875336462628480:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 283us (1966us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788460476.903420:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:3.0:1788460476.940538:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482585600:0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.940622:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460476.940651:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482585600 00000100:00100000:2.0:1788460476.940659:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482585600 00000100:00100000:3.0:1788460476.940682:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788460476.940692:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482585472:0@lo:400:kworker.0 00000100:00100000:2.0:1788460476.940713:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788460476.940725:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460476.940741:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482585600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.940756:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482585984:0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.940798:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460476.940806:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482585600:12345-0@lo:400:kworker.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460476.940815:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788460476.940841:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482585600:0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.940870:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482585856:0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.940895:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460476.940916:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460476.940922:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482585728:0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.940947:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460476.940989:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482585856 00000100:00100000:3.0:1788460476.940995:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482585856 00000100:00100000:2.0:1788460476.941014:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482585728 00000100:00100000:2.0:1788460476.941019:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482585728 00000100:00100000:3.0:1788460476.941043:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788460476.941051:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788460476.941056:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482585856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460476.941065:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482585728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.941106:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482585856:12345-0@lo:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460476.941113:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482585728:12345-0@lo:400:kworker.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460476.941117:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788460476.941126:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788460476.941143:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482585472 00000100:00100000:3.0:1788460476.941148:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482585472 00000100:00100000:0.0:1788460476.941193:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460476.941211:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788460476.941216:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482586112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460476.941233:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482585472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460476.941264:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460476.941277:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d14b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482585472:12345-0@lo:400:kworker.0 Request processed in 57us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460476.941284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788460476.941303:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482586112 00000100:00100000:0.0:1788460476.941308:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482586112 00000100:00080000:3.0:1788460476.941315:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460476.941321:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460476.941344:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482585728:0@lo:400:kworker.0 00000100:00100000:0.0:1788460476.941351:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460476.941357:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482585856:0@lo:400:kworker.0 00000100:00100000:0.0:1788460476.941370:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482586112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460476.941390:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482585472:0@lo:400:kworker.0 00002000:00000024:0.0:1788460476.941401:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460476.941416:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482585984 00000100:00100000:3.0:1788460476.941421:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482585984 00000100:00100000:0.0:1788460476.941446:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482586112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460476.941453:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788460476.941456:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460476.941464:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482585984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460476.941497:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482586112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460476.941512:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482585984:12345-0@lo:400:kworker.0 Request processed in 49us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460476.941521:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788460476.941548:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482585984:0@lo:400:kworker.0 00000100:00100000:3.0:1788460476.941923:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460476.941934:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482586240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460476.941962:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460476.942021:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482586240 00000100:00100000:0.0:1788460476.942026:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482586240 00000100:00100000:0.0:1788460476.942055:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788460476.942062:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482586240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460476.942072:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460476.942288:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482586240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460476.942295:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788460476.942325:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482586240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460476.965467:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460476.965557:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462628736 00000100:00100000:3.0:1788460476.965567:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462628736 00000100:00100000:3.0:1788460476.965715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:3.0:1788460476.965738:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:10357:x1875336462628736:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460476.965830:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460476.965850:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12f6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460476.965936:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788460476.966056:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7575 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12f6 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.966070:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:3.0:1788460476.966074:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460476.966079:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12f6 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.966094:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460476.966385:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:10357:x1875336462628736:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 647us (926us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788460476.966393:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1788460476.977035:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460476.977339:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462628864 00000100:00100000:3.0:1788460476.977349:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462628864 00000100:00100000:3.0:1788460476.977404:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:3.0:1788460476.977413:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:10357:x1875336462628864:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:3.0:1788460476.977484:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977500:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977529:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977544:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977551:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977557:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977649:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977658:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977665:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460476.977703:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977714:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977720:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977726:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977744:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460476.977748:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977756:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977768:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460476.977770:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460476.977775:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977780:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7583 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977794:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977800:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977806:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977811:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460476.977813:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977819:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977835:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c52ede00) 00010000:00010000:3.0:1788460476.977838:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460476.977840:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977847:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b758a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977861:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977867:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977872:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977877:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460476.977879:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977885:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977892:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460476.977895:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460476.977898:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460476.977904:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460476.977986:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:10357:x1875336462628864:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 573us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460476.977995:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1788460476.980856:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460476.980929:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462629120 00000100:00100000:1.0:1788460476.980939:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462629120 00000100:00100000:1.0:1788460476.980990:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460476.980999:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:10357:x1875336462629120:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460476.981255:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:10357:x1875336462629120:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 256us (405us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788460476.981263:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460477.010559:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.010896:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462629376 00000100:00100000:3.0:1788460477.010907:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462629376 00000100:00100000:3.0:1788460477.010963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:3.0:1788460477.010975:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:10360:x1875336462629376:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460477.011002:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460477.011020:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d12fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011442:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011457:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011468:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011482:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011489:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011496:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011613:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011622:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011628:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460477.011638:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788460477.011813:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011821:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011827:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011833:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460477.011836:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011844:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011855:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:2.0:1788460477.011858:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460477.011863:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011879:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b759f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011893:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011899:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011905:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011910:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460477.011913:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011919:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011927:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460477.011929:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460477.011932:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011938:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011979:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.011992:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.012004:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:2.0:1788460477.012006:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460477.012009:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009000, rc 0) 00000100:00100000:2.0:1788460477.012286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:10360:x1875336462629376:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1313us (1734us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788460477.012294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1788460477.015504:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.015590:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462629504 00000100:00100000:3.0:1788460477.015599:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462629504 00000100:00100000:3.0:1788460477.015697:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1788460477.015707:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:10360:x1875336462629504:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:3.0:1788460477.015769:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015785:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015796:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015819:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015827:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015848:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015853:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460477.015857:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015864:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015874:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460477.015878:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460477.015882:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.015889:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460477.015996:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:10360:x1875336462629504:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 290us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460477.016003:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1788460477.018427:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460477.018506:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462629760 00000100:00100000:1.0:1788460477.018515:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462629760 00000100:00100000:1.0:1788460477.018566:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1788460477.018575:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:10360:x1875336462629760:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460477.018900:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:10360:x1875336462629760:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 324us (479us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788460477.018908:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1788460477.295947:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460477.297242:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462630016 00000100:00100000:2.0:1788460477.297254:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462630016 00000100:00100000:2.0:1788460477.297326:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:2.0:1788460477.297336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:10391:x1875336462630016:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:2.0:1788460477.297359:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460477.297377:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1304 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.297467:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b75c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.297481:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b75c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.297493:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b75c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460477.297505:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788460477.297766:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b75c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1304 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.297805:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b75c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1304 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.297814:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:2.0:1788460477.297817:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460477.297820:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009e00, rc 0) 00000100:00100000:2.0:1788460477.298276:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:10391:x1875336462630016:12345-192.168.203.32@tcp:101:cat.0 Request processed in 940us (2406us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788460477.298284:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:0.0:1788460477.304657:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460477.304707:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.304802:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462630144 00000100:00100000:3.0:1788460477.304812:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462630144 00000100:00100000:3.0:1788460477.304885:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1788460477.304895:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:2382:x1875336462630144:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460477.304910:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460477.304934:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b75c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1304 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.304963:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460477.304967:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460477.305021:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:2382:x1875336462630144:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 127us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460477.305029:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1788460477.308249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462630400 00000100:00100000:2.0:1788460477.308264:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462630400 00000100:00100000:2.0:1788460477.308390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1788460477.308400:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:10391:x1875336462630400:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:2.0:1788460477.308706:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:10391:x1875336462630400:12345-192.168.203.32@tcp:35:cat.0 Request processed in 306us (3996us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788460477.308714:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1788460477.360428:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460477.360538:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462630656 00000100:00100000:0.0:1788460477.360550:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462630656 00000100:00100000:0.0:1788460477.360612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:0.0:1788460477.360622:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:10397:x1875336462630656:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:0.0:1788460477.360655:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460477.360658:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788460477.360688:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b752f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12da expref: 36 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.360721:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460477.360726:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460477.360743:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b75d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d130b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.360838:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.360852:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.360860:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.360892:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.360904:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 36 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460477.360916:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482586368:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460477.361003:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460477.365387:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460477.365531:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd2aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482586368:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460477.365557:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460477.365920:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462630784 00000100:00100000:2.0:1788460477.365927:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462630784 00010000:00010000:2.0:1788460477.365969:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 37 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460477.366014:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1788460477.366023:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:2379:x1875336462630784:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460477.366388:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460477.366407:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 37 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.366421:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 37 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.366442:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b75ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12fd expref: 37 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.366457:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:2.0:1788460477.366462:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.366471:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.366490:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.366511:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460477.366570:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:2379:x1875336462630784:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 547us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460477.366578:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00010000:00010000:1.0:1788460477.367437:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.367449:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460477.367470:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788460477.367645:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b75d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.367663:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.367670:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460477.367673:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788460477.367676:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5bc00, rc 0) 00000100:00100000:1.0:1788460477.367727:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:10397:x1875336462630656:12345-192.168.203.32@tcp:101:dd.0 Request processed in 7106us (7309us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788460477.367734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:0.0:1788460477.371063:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.371243:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462631040 00000100:00100000:3.0:1788460477.371253:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462631040 00000100:00100000:3.0:1788460477.371306:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1788460477.371315:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:10397:x1875336462631040:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:3.0:1788460477.371576:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.371592:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.371603:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460477.371664:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788460477.371692:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5b2459e reply state 00000000ed1f8ff1 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460477.371700:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460477.371802:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+39:10397:x1875336462631040:12345-192.168.203.32@tcp:36:dd.0 Request processed in 486us (747us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788460477.371808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000020:00080000:3.0:1788460477.371813:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788460477.387485:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.387502:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.387523:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.387529:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ca00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460477.387534:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.387541:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.387569:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:0.0:1788460477.387572:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460477.387576:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460477.387583:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b75ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460477.645893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.646632:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462631168 00000100:00100000:3.0:1788460477.646642:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462631168 00000100:00100000:3.0:1788460477.646709:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:3.0:1788460477.646719:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:10411:x1875336462631168:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:3.0:1788460477.646746:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460477.646766:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b75f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1312 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646827:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646840:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646852:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646866:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646873:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646880:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646964:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.646975:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.647001:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.647035:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.647050:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 39 pid: 5844 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460477.647064:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482586496:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460477.648250:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788460477.653459:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460477.653561:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462631424 00000100:00100000:1.0:1788460477.653581:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462631424 00000100:00100000:0.0:1788460477.653635:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482586496:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460477.653638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1788460477.653652:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:5618:x1875336462631424:12345-192.168.203.32@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1788460477.653670:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460477.653986:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+41:5618:x1875336462631424:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 335us (534us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788460477.653994:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460477.655878:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.655953:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462631552 00000100:00100000:3.0:1788460477.655962:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462631552 00010000:00010000:3.0:1788460477.655999:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 41 pid: 5844 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460477.656040:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1788460477.656050:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+41:2380:x1875336462631552:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460477.656063:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460477.656069:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 41 pid: 5844 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.656081:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 41 pid: 5844 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.656132:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b75de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d130b expref: 41 pid: 5844 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.656148:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460477.656154:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.656163:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.656170:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.656297:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460477.656342:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:2380:x1875336462631552:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 293us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460477.656349:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00010000:00010000:1.0:1788460477.656934:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.656944:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460477.656984:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788460477.656988:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460477.657029:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657042:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657052:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657058:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657064:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657070:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460477.657074:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657090:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657112:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460477.657115:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460477.657119:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657125:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b75fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657137:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657143:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657148:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657153:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460477.657155:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657160:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657167:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c52ede00) 00010000:00010000:1.0:1788460477.657169:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460477.657172:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657226:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657374:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b75f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1312 expref: 40 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657389:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1312 expref: 39 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.657396:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460477.657546:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460477.657552:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029de00, rc 0) 00000100:00100000:1.0:1788460477.657604:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+39:10411:x1875336462631168:12345-192.168.203.32@tcp:101:stat.0 Request processed in 10886us (11720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460477.657612:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:0.0:1788460477.715918:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460477.716166:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462631808 00000100:00100000:2.0:1788460477.716175:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462631808 00000100:00100000:2.0:1788460477.716350:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460477.716362:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+39:10417:x1875336462631808:12345-192.168.203.32@tcp:36:truncate.0 00010000:00010000:2.0:1788460477.716418:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460477.716444:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1312 expref: 39 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.716475:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:2.0:1788460477.716480:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460477.716666:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.716678:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.716687:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460477.716726:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788460477.716746:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af64c5c4 reply state 000000000144c3a9 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460477.716755:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460477.716903:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+41:10417:x1875336462631808:12345-192.168.203.32@tcp:36:truncate.0 Request processed in 542us (991us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788460477.716910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000020:00080000:2.0:1788460477.716914:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788460477.729356:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.729376:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.729384:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.729390:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460477.729411:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.729418:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.729434:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:2.0:1788460477.729437:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460477.729442:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460477.729448:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b760f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460477.820427:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460477.820532:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462631936 00000100:00100000:1.0:1788460477.820541:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462631936 00000100:00100000:1.0:1788460477.820603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:1.0:1788460477.820613:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:10431:x1875336462631936:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:1.0:1788460477.820638:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460477.820657:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7616 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1319 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820719:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820758:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820774:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820781:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820788:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820895:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820903:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820909:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460477.820957:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788460477.820962:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460477.820981:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820992:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.820999:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821015:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821021:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821027:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460477.821032:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821039:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821051:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460477.821054:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460477.821058:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821064:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b761d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821078:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821083:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821089:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821093:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460477.821103:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821108:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821116:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c34d0f00) 00010000:00010000:1.0:1788460477.821118:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460477.821121:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821126:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821156:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7616 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821785:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460477.821793:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460477.821795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460477.821809:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5a00, rc 0) 00000100:00100000:1.0:1788460477.821888:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+41:10431:x1875336462631936:12345-192.168.203.32@tcp:101:stat.0 Request processed in 1276us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460477.821897:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00010000:00010000:3.0:1788460477.836770:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460477.929419:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.929559:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462632192 00000100:00100000:3.0:1788460477.929569:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462632192 00000100:00100000:3.0:1788460477.929630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:3.0:1788460477.929640:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+41:10441:x1875336462632192:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460477.929661:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460477.929681:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1320 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460477.929769:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788460477.929907:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7632 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1320 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.929921:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:3.0:1788460477.929924:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460477.929929:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1320 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460477.929943:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c200, rc 0) 00000100:00100000:3.0:1788460477.930168:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+42:10441:x1875336462632192:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 528us (756us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788460477.930175:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:0.0:1788460477.934777:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460477.934992:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462632448 00000100:00100000:3.0:1788460477.935002:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462632448 00000100:00100000:3.0:1788460477.935436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460477.935447:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+42:10441:x1875336462632448:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1788460477.935671:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:10441:x1875336462632448:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 225us (900us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788460477.935678:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:0.0:1788460478.021555:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460478.022498:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462632704 00000100:00100000:1.0:1788460478.022510:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462632704 00000100:00100000:1.0:1788460478.022578:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1788460478.022589:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:10447:x1875336462632704:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460478.022624:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460478.022655:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7640 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1327 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.022753:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.022767:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.022775:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.022810:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.022822:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 44 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460478.022833:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482586624:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460478.022944:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de900 going to sleep for 11 seconds 00000100:00080000:3.0:1788460478.025354:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460478.025610:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482586624:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460478.025637:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460478.026059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460478.026290:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462632832 00000100:00100000:3.0:1788460478.026298:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462632832 00010000:00010000:3.0:1788460478.026331:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 45 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460478.026371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1788460478.026381:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ea552c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:2379:x1875336462632832:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460478.026411:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460478.026419:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 45 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.026432:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 45 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.026458:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b762b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1319 expref: 45 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.026474:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460478.026479:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.026488:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.026496:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.026526:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460478.026581:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ea552c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:2379:x1875336462632832:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 201us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460478.026589:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00010000:00010000:1.0:1788460478.026954:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.026962:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460478.026989:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788460478.027300:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7640 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 45 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.027317:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 44 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.027324:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460478.027326:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788460478.027329:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4400, rc 0) 00000100:00100000:1.0:1788460478.027360:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:10447:x1875336462632704:12345-192.168.203.32@tcp:101:bash.0 Request processed in 4774us (5814us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788460478.027440:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:0.0:1788460478.033558:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460478.033867:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462633088 00000100:00100000:2.0:1788460478.033876:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462633088 00000100:00100000:2.0:1788460478.033933:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:2.0:1788460478.033943:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:10447:x1875336462633088:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:2.0:1788460478.034630:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460478.034650:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460478.034662:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460478.034740:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788460478.034768:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042ae6de1 reply state 00000000f0859721 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460478.034778:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460478.035024:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:10447:x1875336462633088:12345-192.168.203.32@tcp:36:bash.0 Request processed in 1079us (1470us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788460478.035033:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000020:00080000:2.0:1788460478.035039:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788460478.038102:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.038120:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.038128:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.038134:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460478.038139:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.038147:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.038225:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460478.038229:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460478.038234:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.038241:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7655 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460478.042545:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460478.042762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462633216 00000100:00100000:1.0:1788460478.042771:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462633216 00000100:00100000:1.0:1788460478.042820:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1788460478.042830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+46:10447:x1875336462633216:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460478.042863:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460478.042883:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b765c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d132e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.042960:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.042975:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 47 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.042983:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.043014:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 47 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.043027:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 47 pid: 7007 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460478.043054:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482586752:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460478.043281:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460478.046796:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482586752:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460478.046823:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460478.048955:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460478.049452:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462633344 00000100:00100000:3.0:1788460478.049462:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462633344 00010000:00010000:3.0:1788460478.049499:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 48 pid: 7007 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460478.049592:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:3.0:1788460478.049601:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:2379:x1875336462633344:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460478.049614:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460478.049622:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 48 pid: 7007 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.049634:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 48 pid: 7007 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.049666:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7647 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1327 expref: 48 pid: 7007 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.049683:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460478.049688:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.049696:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.049703:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.049737:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460478.049839:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:2379:x1875336462633344:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 238us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460478.049847:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00010000:00010000:0.0:1788460478.050005:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.050013:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460478.050067:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788460478.050072:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460478.050088:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.050129:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b765c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d132e expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.050145:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d132e expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.050152:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:0.0:1788460478.050154:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460478.050157:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5800, rc 0) 00000100:00100000:0.0:1788460478.050224:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+46:10447:x1875336462633216:12345-192.168.203.32@tcp:101:bash.0 Request processed in 7386us (7679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460478.050232:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1788460478.053468:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460478.053547:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462633600 00000100:00100000:3.0:1788460478.053570:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462633600 00000100:00100000:3.0:1788460478.053728:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1788460478.053739:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2868c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+46:10447:x1875336462633600:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:3.0:1788460478.053991:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2868c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:10447:x1875336462633600:12345-192.168.203.32@tcp:35:bash.0 Request processed in 252us (531us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788460478.053999:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1788460478.121679:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460478.121763:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462633856 00000100:00100000:3.0:1788460478.121772:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462633856 00000100:00100000:3.0:1788460478.121829:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:3.0:1788460478.121838:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:10457:x1875336462633856:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460478.121860:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460478.121878:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b766a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1335 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460478.121957:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788460478.122083:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b766a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1335 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.122108:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:3.0:1788460478.122111:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460478.122116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b766a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1335 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.122130:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c200, rc 0) 00000100:00100000:3.0:1788460478.122389:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:10457:x1875336462633856:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 550us (720us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788460478.122397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:1.0:1788460478.125223:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460478.125308:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462633984 00000100:00100000:0.0:1788460478.125318:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462633984 00000100:00100000:0.0:1788460478.125418:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1788460478.125426:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:10457:x1875336462633984:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1788460478.125484:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125496:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125504:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125515:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125519:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125523:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125587:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125592:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125596:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460478.125626:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125635:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125646:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125653:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125658:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460478.125663:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125764:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125776:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460478.125778:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460478.125783:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125788:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125800:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125804:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125809:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125813:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460478.125821:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125826:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125832:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650d2c3c100) 00010000:00010000:0.0:1788460478.125834:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460478.125836:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125840:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b767f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125908:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125914:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125919:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125922:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460478.125924:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125929:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125935:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:0.0:1788460478.125937:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460478.125944:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.125949:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460478.126015:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:10457:x1875336462633984:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 588us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460478.126029:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1788460478.134474:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460478.134610:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462634240 00000100:00100000:2.0:1788460478.134620:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462634240 00000100:00100000:2.0:1788460478.134679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1788460478.134690:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:10457:x1875336462634240:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460478.134947:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+49:10457:x1875336462634240:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 258us (481us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788460478.134955:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1788460478.170396:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460478.171118:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462634496 00000100:00100000:3.0:1788460478.171129:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462634496 00000100:00100000:3.0:1788460478.171208:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:3.0:1788460478.171229:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+49:10460:x1875336462634496:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460478.171254:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460478.171272:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b768d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d133c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171342:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171356:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171367:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171380:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171386:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171392:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171499:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b76a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171507:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b76a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171533:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b76a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460478.171543:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788460478.171631:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171639:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171646:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171652:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029dc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460478.171656:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171664:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171675:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460478.171678:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460478.171682:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171688:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7694 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171700:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171706:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171720:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171727:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460478.171730:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171736:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171743:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c52ed700) 00010000:00010000:3.0:1788460478.171746:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460478.171749:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171754:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b769b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171793:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b768d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d133c expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171805:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b76a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d133c expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.171812:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460478.171814:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460478.171817:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029de00, rc 0) 00000100:00100000:3.0:1788460478.172005:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:10460:x1875336462634496:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 786us (1615us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788460478.172021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1788460478.178063:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460478.178210:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462634624 00000100:00100000:0.0:1788460478.178229:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462634624 00000100:00100000:0.0:1788460478.178321:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:0.0:1788460478.178331:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:10460:x1875336462634624:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1788460478.178397:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178415:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178425:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178457:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178465:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178471:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178493:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460478.178498:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178505:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178518:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:0.0:1788460478.178521:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460478.178525:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.178531:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b76b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460478.178617:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:10460:x1875336462634624:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 286us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460478.178625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1788460478.179262:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460478.179640:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462634752 00000100:00100000:2.0:1788460478.179648:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462634752 00000100:00100000:2.0:1788460478.179702:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1788460478.179712:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:2382:x1875336462634752:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460478.179725:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460478.179744:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b76a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d133c expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460478.179762:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:2.0:1788460478.179766:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460478.179811:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:2382:x1875336462634752:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 101us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460478.179819:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1788460478.182685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460478.182742:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462635008 00000100:00100000:2.0:1788460478.182750:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462635008 00000100:00100000:2.0:1788460478.182796:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460478.182806:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:10460:x1875336462635008:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460478.183035:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:10460:x1875336462635008:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 229us (359us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788460478.183043:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460478.334407:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460478.334504:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462635264 00000100:00100000:3.0:1788460478.334515:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462635264 00000100:00100000:3.0:1788460478.334577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:3.0:1788460478.334587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:10478:x1875336462635264:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1788460478.334617:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460478.334635:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1343 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.334734:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b76be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.334748:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b76be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.334757:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b76be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460478.334767:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788460478.334896:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1343 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.334915:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b76be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1343 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.334923:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:3.0:1788460478.334927:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788460478.334943:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c400, rc 0) 00000100:00100000:3.0:1788460478.335009:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10478:x1875336462635264:12345-192.168.203.32@tcp:101:cat.0 Request processed in 422us (610us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788460478.335016:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:3.0:1788460478.367414:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460478.367658:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462635392 00000100:00100000:1.0:1788460478.367669:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462635392 00000100:00100000:1.0:1788460478.367730:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:1.0:1788460478.367739:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10479:x1875336462635392:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460478.367762:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460478.367782:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b76cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d134a expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.367843:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b76d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.367865:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b76d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.367876:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b76d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460478.367911:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788460478.367914:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460478.367945:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b76d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.367982:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b76cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d134a expref: 55 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.368001:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b76d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d134a expref: 54 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.368009:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460478.368012:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460478.368015:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5600, rc 0) 00000100:00100000:1.0:1788460478.368082:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10479:x1875336462635392:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 344us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460478.369076:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1788460478.379125:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460478.379243:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462635776 00000100:00100000:2.0:1788460478.379373:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462635776 00000100:00100000:2.0:1788460478.379438:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1788460478.379448:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10479:x1875336462635776:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460478.381006:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10479:x1875336462635776:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 307us (638us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788460478.381020:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:2.0:1788460478.382138:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460478.382248:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462635904 00000100:00100000:1.0:1788460478.382264:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462635904 00000100:00100000:1.0:1788460478.382326:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460478.382336:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10479:x1875336462635904:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:1.0:1788460478.382349:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788460478.382381:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d132e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.382403:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b76be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1343 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.382415:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b756e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12ef expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.382442:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0e00) 00010000:00010000:1.0:1788460478.382452:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460478.382504:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:10479:x1875336462635904:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 170us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460478.382511:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:0.0:1788460478.388282:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460478.389504:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462636032 00000100:00100000:3.0:1788460478.389516:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462636032 00000100:00100000:3.0:1788460478.389645:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:3.0:1788460478.389656:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:10479:x1875336462636032:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:3.0:1788460478.389792:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.389807:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460478.389819:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460478.390110:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460478.390373:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788460478.390439:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788460478.390547:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:10479:x1875336462636032:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 891us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460478.390557:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:0.0:1788460478.423436:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460478.423653:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462636160 00000100:00100000:1.0:1788460478.423664:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462636160 00000100:00100000:1.0:1788460478.423714:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:1.0:1788460478.423724:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:10481:x1875336462636160:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460478.423744:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460478.423760:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b76e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1351 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423817:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423831:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423842:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423857:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423865:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423889:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423969:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423978:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460478.423984:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460478.424017:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788460478.424021:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460478.425610:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425631:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425845:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425871:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425877:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425883:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460478.425888:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425896:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425911:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460478.425914:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460478.425918:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425924:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b76e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425938:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425944:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425950:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425955:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460478.425964:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425971:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425980:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c34d0e00) 00010000:00010000:0.0:1788460478.425982:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460478.425985:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.425991:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b76ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.426142:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b76e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.426160:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460478.426167:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:0.0:1788460478.426170:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460478.426172:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5400, rc 0) 00000100:00100000:0.0:1788460478.426324:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10481:x1875336462636160:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2600us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460478.426332:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00010000:00010000:0.0:1788460478.860699:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460479.052855:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460479.052863:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460479.054013:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788460479.054030:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460479.054813:0:11722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd28000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482586880:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460479.055768:0:11722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f611bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460479.062673:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.062768:0:11722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd28000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482586880:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460479.065293:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462636288 00000100:00100000:3.0:1788460479.065307:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462636288 00000100:00100000:3.0:1788460479.065379:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1788460479.065389:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10492:x1875336462636288:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788460479.065478:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10492:x1875336462636288:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 Request processed in 90us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.065493:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1788460479.069979:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.073703:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462636416 00000100:00100000:2.0:1788460479.073719:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462636416 00000100:00100000:2.0:1788460479.078254:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:2.0:1788460479.078273:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10492:x1875336462636416:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460479.078303:0:5842:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788460479.078410:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10492:x1875336462636416:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 144us (8440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.078418:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1788460479.087340:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.087373:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462636544 00000100:00100000:3.0:1788460479.087381:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462636544 00000100:00100000:3.0:1788460479.087433:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1788460479.087442:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10492:x1875336462636544:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788460479.087509:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.087538:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.087551:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.087615:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.087624:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.087631:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089333:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089344:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089369:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460479.089410:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788460479.089414:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460479.089428:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089439:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089445:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089452:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089457:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460479.089461:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089467:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089479:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:3.0:1788460479.089482:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460479.089487:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089492:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b76fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089513:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089519:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.089524:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090414:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029dc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460479.090418:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090425:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090435:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9650c52ede00) 00010000:00010000:3.0:1788460479.090438:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460479.090441:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090446:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7704 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090464:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090469:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090474:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090488:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460479.090491:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090496:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090504:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:3.0:1788460479.090507:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460479.090509:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.090514:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b770b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460479.091077:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10492:x1875336462636544:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 3632us (3741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.091725:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:1.0:1788460479.100713:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.100999:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462636800 00000100:00100000:3.0:1788460479.101009:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462636800 00000100:00100000:3.0:1788460479.101073:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1788460479.101093:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10492:x1875336462636800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460479.101115:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460479.101135:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7712 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1358 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101289:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101324:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101337:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460479.101350:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788460479.101445:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101453:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101459:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101465:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460479.101469:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101476:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101488:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:3.0:1788460479.101491:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460479.101495:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101501:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101549:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7712 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1358 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101565:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:3.0:1788460479.101567:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460479.101572:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7712 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1358 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.101581:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c000, rc 0) 00000100:00100000:3.0:1788460479.101644:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10492:x1875336462636800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 563us (941us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788460479.101651:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:1.0:1788460479.108593:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.108675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462636928 00000100:00100000:3.0:1788460479.108684:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462636928 00000100:00100000:3.0:1788460479.108741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:3.0:1788460479.108752:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10492:x1875336462636928:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460479.108783:0:5844:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460479.108884:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10492:x1875336462636928:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.108893:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:1.0:1788460479.114861:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.115002:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462637184 00000100:00100000:3.0:1788460479.115012:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462637184 00000100:00100000:3.0:1788460479.115078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:3.0:1788460479.115096:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10492:x1875336462637184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460479.115121:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460479.115125:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788460479.115153:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b76d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d134a expref: 54 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.115233:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460479.115239:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460479.115254:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7727 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d135f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460479.115641:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788460479.115831:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b772e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.115846:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b772e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.115856:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b772e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.115918:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7727 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d135f expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.115933:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b772e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d135f expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.115940:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650c52ede00) 00010000:00010000:3.0:1788460479.115943:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460479.115945:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460479.116005:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10492:x1875336462637184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 913us (1153us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788460479.116013:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:1.0:1788460479.123046:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.125146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462637440 00000100:00100000:2.0:1788460479.125158:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462637440 00000100:00100000:2.0:1788460479.125301:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:2.0:1788460479.125312:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10492:x1875336462637440:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788460479.125367:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460479.125394:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b772e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d135f expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125412:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650c52ede00) 00010000:00010000:2.0:1788460479.125423:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460479.125443:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125454:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125462:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125481:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125486:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125557:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125576:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125582:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125588:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460479.125592:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125599:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125609:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:2.0:1788460479.125611:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460479.125615:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125621:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b773c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.125630:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.126616:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.126623:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.126628:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460479.126700:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.126707:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.126718:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x76ea7985 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460479.126721:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460479.126725:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.126731:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7743 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x76ea7985 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.126829:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10492:x1875336462637440:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 1515us (3789us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460479.126837:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1788460479.133408:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460479.133514:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462637568 00000100:00100000:0.0:1788460479.133524:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462637568 00000100:00100000:0.0:1788460479.133584:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:0.0:1788460479.133595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10492:x1875336462637568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460479.133617:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460479.133649:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b774a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1366 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.133683:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.133697:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.133708:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.133793:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b774a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.133809:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.133818:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:0.0:1788460479.133821:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460479.133830:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b800, rc 0) 00000100:00100000:0.0:1788460479.133901:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10492:x1875336462637568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 308us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460479.133908:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:1.0:1788460479.137406:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.137682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462637824 00000100:00100000:3.0:1788460479.137694:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462637824 00000100:00100000:3.0:1788460479.137761:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:3.0:1788460479.137771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10492:x1875336462637824:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460479.137844:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.137860:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.137871:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460479.138482:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788460479.138492:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352374313014ns, next at 353374310604ns, rc = 0 00000004:00010000:3.0:1788460479.138594:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f37586 reply state 000000006b110542 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460479.138605:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460479.138707:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:10492:x1875336462637824:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 936us (1307us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788460479.138715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:2.0:1788460479.145405:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:2.0:1788460479.145439:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145451:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145460:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145467:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029dc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460479.145472:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145480:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145503:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:2.0:1788460479.145506:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460479.145511:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145518:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7758 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.145549:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462637952 00000100:00100000:2.0:1788460479.145558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462637952 00000100:00100000:2.0:1788460479.145608:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:2.0:1788460479.145617:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:10492:x1875336462637952:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460479.145639:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460479.145654:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d136d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145705:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145718:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.145736:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:2.0:1788460479.145739:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460479.145742:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009400, rc 0) 00000100:00100000:2.0:1788460479.145792:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:10492:x1875336462637952:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 175us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.145809:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:1.0:1788460479.155689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.155814:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462638080 00000100:00100000:3.0:1788460479.155824:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462638080 00000100:00100000:3.0:1788460479.155869:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1788460479.155885:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2378:x1875336462638080:12345-192.168.203.32@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788460479.155917:0:6699:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from 9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:3.0:1788460479.155959:0:6699:0:(genops.c:1385:class_connect()) connect: client 9e69358b-6b5d-4a87-b6fb-534c610a3920, cookie 0x889bb893541b7766 00002000:00100000:3.0:1788460479.155973:0:6699:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e69358b-6b5d-4a87-b6fb-534c610a3920/ffff9650c5014000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460479.155995:0:6699:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460479.156721:0:6699:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788460479.156754:0:6699:0:(import.c:65:import_set_state_nolock()) ffff9650c5015800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460479.156866:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2378:x1875336462638080:12345-192.168.203.32@tcp:8:lhsmtool_posix.0 Request processed in 980us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.156885:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:1.0:1788460479.170064:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.170231:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462638208 00000100:00100000:2.0:1788460479.170240:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462638208 00000100:00100000:2.0:1788460479.170309:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:2.0:1788460479.170320:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:0:x1875336462638208:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788460479.170782:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788460479.233800:0:12039:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460479.233809:0:12039:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460479.233842:0:12039:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788460479.233847:0:12039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788460479.265428:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1788460479.265446:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000100:00100000:1.0:1788460479.266691:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:0:x1875336462638208:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 96364us (96627us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788460479.266702:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1788460479.277099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460479.277196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462638464 00000100:00100000:1.0:1788460479.277213:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462638464 00000100:00100000:1.0:1788460479.277260:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460479.277270:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:10492:x1875336462638464:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788460479.277494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:10492:x1875336462638464:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 225us (403us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788460479.277501:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460479.282563:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.283226:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462638720 00000100:00100000:3.0:1788460479.283237:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462638720 00000100:00100000:3.0:1788460479.283305:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:3.0:1788460479.283317:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:10492:x1875336462638720:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788460479.283440:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:10492:x1875336462638720:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 124us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.283448:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:1.0:1788460479.296735:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460479.300017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462638848 00000100:00100000:0.0:1788460479.302201:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462638848 00000100:00100000:1.0:1788460479.302396:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1788460479.302409:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:10492:x1875336462638848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460479.302429:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460479.302448:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b776d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1374 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.302513:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.302528:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.302539:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460479.302574:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460479.302593:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.302948:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b776d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1374 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.303026:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1374 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.303046:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:1.0:1788460479.303049:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788460479.303053:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5800, rc 0) 00000100:00100000:1.0:1788460479.303331:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:10492:x1875336462638848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 925us (6604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460479.303339:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1788460479.312362:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.312477:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462638976 00000100:00100000:3.0:1788460479.312487:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462638976 00000100:00100000:3.0:1788460479.312551:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1788460479.312562:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2380:x1875336462638976:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460479.312578:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460479.312597:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d137b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460479.312622:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bdbe, blocks: 0x1 00010000:00010000:3.0:1788460479.312650:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1788460479.312656:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460479.312664:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.312695:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.312707:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c000, rc 0) 00000100:00100000:3.0:1788460479.312761:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462638976:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 201us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.312767:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:0.0:1788460479.315592:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.315663:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462639232 00000100:00100000:3.0:1788460479.315672:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462639232 00000100:00100000:3.0:1788460479.315725:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:3.0:1788460479.315734:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:10492:x1875336462639232:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788460479.315839:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:10492:x1875336462639232:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.315847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:3.0:1788460479.318221:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460479.318495:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462639360 00000100:00100000:0.0:1788460479.318505:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462639360 00000100:00100000:0.0:1788460479.318565:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:0.0:1788460479.318574:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:10492:x1875336462639360:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460479.318591:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460479.318609:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1382 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.318648:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.318657:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460479.318661:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460479.318665:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.318715:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.318729:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 7 pid: 6699 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460479.318742:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482587008:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460479.318822:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460479.321774:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.322524:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd2aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482587008:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460479.322558:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.322577:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a400, rc 0) 00000100:00100000:3.0:1788460479.322637:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:10492:x1875336462639360:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 4064us (4433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.322645:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:2.0:1788460479.323570:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462639488 00000100:00100000:2.0:1788460479.323579:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462639488 00010000:00010000:2.0:1788460479.323615:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 7 pid: 6699 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.323857:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:2.0:1788460479.323868:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462639488:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460479.324569:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460479.324593:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 7 pid: 6699 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.324608:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 7 pid: 6699 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.324646:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb91b8c0/0x889bb893541b777b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d137b expref: 7 pid: 6699 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.324662:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460479.324676:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460479.324685:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.324695:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.324733:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.324747:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875336482587136:192.168.203.32@tcp:105: 00000100:00100000:2.0:1788460479.324866:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5856600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460479.335926:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875336482587136:192.168.203.32@tcp:105: 00010000:00010000:3.0:1788460479.335954:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460479.336546:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462639488:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 12677us (14776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.336556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1788460479.336960:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.337732:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462639616 00000100:00100000:2.0:1788460479.337742:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462639616 00002000:00100000:2.0:1788460479.337789:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9650d0263480 x1875336462639616/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:635/0 lens 504/0 e 0 to 0 dl 1788460490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460479.337799:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0263480 with x1875336462639616 ext(0->8) 00002000:00010000:2.0:1788460479.337805:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650d0263480 00000100:00100000:2.0:1788460479.337834:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1788460479.337843:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462639616:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788460479.338491:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462639616:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 647us (1530us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788460479.338500:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00002000:00100000:2.0:1788460479.338507:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9650d0263480 x1875336462639616/t4294967302(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:635/0 lens 504/448 e 0 to 0 dl 1788460490 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460479.338528:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0263480 with x1875336462639616 ext(0->8) 00002000:00010000:2.0:1788460479.338533:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650d0263480 00000100:00100000:3.0:1788460479.342898:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.342966:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462639744 00000100:00100000:2.0:1788460479.342975:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462639744 00000100:00100000:2.0:1788460479.343034:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:2.0:1788460479.343044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:10492:x1875336462639744:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788460479.377259:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:3.0:1788460479.377273:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788460479.377297:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650d831a0c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788460479.377301:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e89b6000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650ea59b600 00000020:00080000:3.0:1788460479.377305:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e89b6800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9650f5dd7000 00000001:00080000:3.0:1788460479.377327:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788460479.377393:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788460479.377546:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788460479.377667:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788460479.377746:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482587264:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788460479.377775:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482587392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788460479.377813:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460479.377848:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460479.377895:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482587264 00000100:00100000:0.0:1788460479.377896:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482587392 00000100:00100000:3.0:1788460479.377905:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482587264 00000100:00100000:0.0:1788460479.377905:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482587392 00000100:00100000:3.0:1788460479.377954:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788460479.377963:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482587264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788460479.377989:0:6699:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788460479.378023:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a99bdbb, atime: 0x6a99bdbb, ctime: 0x6a99bdbb, blocks: 0x1 00010000:00010000:3.0:1788460479.378044:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378072:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1788460479.378077:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460479.378090:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378105:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378115:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378122:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378137:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460479.378165:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788460479.378175:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482587392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788460479.378338:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788460479.378343:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788460478 00002000:00010000:0.0:1788460479.378345:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788460479.378462:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788460478 -> 1788460478 00002000:00010000:0.0:1788460479.378466:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788460479.378517:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482587392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (670us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788460479.378627:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482587264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 663us (814us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788460479.378635:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788460479.378661:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788460479.378668:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788460479.378671:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378682:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460479.378686:0:7659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788460479.378693:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788460479.378708:0:7659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378724:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378732:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4572538/0x889bb893541b7789 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.378749:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460479.378751:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460479.378753:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460479.378775:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788460479.378784:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650d0a3ea00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788460479.378791:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482587264:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788460479.378808:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650fd3c4e00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788460479.378815:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482587392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788460479.379490:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:10492:x1875336462639744:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 36444us (36598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.379502:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:3.0:1788460479.387813:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460479.394752:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462639872 00000100:00100000:1.0:1788460479.394764:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462639872 00000100:00100000:1.0:1788460479.394821:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1788460479.394832:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462639872:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788460479.477954:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462639872:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 83113us (90138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.477969:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000001:00080000:2.0:1788460479.478009:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788460479.478019:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788460479.482164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.482582:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462640128 00000100:00100000:3.0:1788460479.482593:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462640128 00000100:00100000:3.0:1788460479.482691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:3.0:1788460479.482701:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:10492:x1875336462640128:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460479.482751:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460479.482779:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1374 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.482795:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:3.0:1788460479.482800:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460479.482840:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.482853:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.482863:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460479.483268:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd460185 reply state 000000002433f1ec transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460479.483278:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460479.483365:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:10492:x1875336462640128:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 665us (1208us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788460479.483372:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00010000:00010000:0.0:1788460479.487578:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.487596:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.487605:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.487611:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460479.487615:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.487623:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.487651:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:0.0:1788460479.487654:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460479.487660:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.487666:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7790 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.491117:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460479.491301:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462640256 00000100:00100000:0.0:1788460479.491311:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462640256 00000100:00100000:0.0:1788460479.491362:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1788460479.491373:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462640256:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788460479.491623:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788460479.491627:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788460478 -> 1788460477 00002000:00010000:0.0:1788460479.491635:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788460475 00002000:00010000:0.0:1788460479.491637:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788460478 -> 1788460477 00002000:00010000:0.0:1788460479.491639:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788460479.491702:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462640256:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 332us (593us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788460479.491710:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:1.0:1788460479.494992:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460479.495073:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462640512 00000100:00100000:0.0:1788460479.495082:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462640512 00000100:00100000:0.0:1788460479.495133:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:0.0:1788460479.495143:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:10492:x1875336462640512:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788460479.495254:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.495272:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.495282:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.495335:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.495349:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 13 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460479.495376:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0205c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482587520:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460479.495457:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460479.497117:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0205c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482587520:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460479.497146:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460479.505635:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460479.506141:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462640640 00000100:00100000:3.0:1788460479.506151:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462640640 00010000:00010000:3.0:1788460479.506382:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.506523:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1788460479.506536:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:2379:x1875336462640640:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460479.506550:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460479.506558:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.506573:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.506613:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1366 expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.506631:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:2.0:1788460479.506636:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.506645:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.506652:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.506684:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460479.506741:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2379:x1875336462640640:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 209us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.506749:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00010000:00010000:0.0:1788460479.507017:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507026:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507054:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507061:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507067:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507072:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460479.507076:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507092:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507102:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:0.0:1788460479.507112:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788460479.507116:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.507121:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7797 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460479.507168:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+12:10492:x1875336462640512:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 12027us (12185us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788460479.507175:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:1.0:1788460479.515644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.516065:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462640768 00000100:00100000:2.0:1788460479.516076:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462640768 00000100:00100000:2.0:1788460479.516130:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1788460479.516141:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462640768:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788460479.516214:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.516235:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.516271:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460479.516275:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460479.516280:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.516327:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.516341:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 7 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.516357:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8864:1875336482587648:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460479.516438:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5856240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460479.520453:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460479.520511:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462640896 00000100:00100000:0.0:1788460479.520520:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462640896 00010000:00010000:0.0:1788460479.520554:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 8 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.520555:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8864:1875336482587648:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460479.520584:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460479.520593:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1788460479.520603:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462640896:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460479.520617:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460479.520649:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 8 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.520662:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 8 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.520684:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b591243/0x889bb893541b7782 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1382 expref: 8 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.520698:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460479.520713:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460479.520719:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.520729:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.520755:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460479.520799:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462640896:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 198us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460479.520806:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00010000:00010000:2.0:1788460479.521877:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521894:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521926:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521948:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521956:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521963:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460479.521968:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521977:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521992:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.521998:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080bf52a3/0x889bb893541b779e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.522109:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462640768:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 5967us (6471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.522118:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1788460479.524714:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460479.525035:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462641152 00000100:00100000:1.0:1788460479.525046:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462641152 00000100:00100000:1.0:1788460479.525135:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:1.0:1788460479.525145:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+12:10492:x1875336462641152:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788460479.525263:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.525281:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.525292:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.525517:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.525529:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.525537:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.525568:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.525581:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 13 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460479.525596:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482587776:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460479.525693:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460479.528493:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482587776:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460479.528524:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460479.529171:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460479.529535:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462641280 00000100:00100000:1.0:1788460479.529544:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462641280 00010000:00010000:1.0:1788460479.529583:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460479.529622:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1788460479.529638:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:2380:x1875336462641280:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460479.529652:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460479.529660:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.529691:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.529714:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b775f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d136d expref: 14 pid: 5843 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.529729:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:1.0:1788460479.529733:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.529742:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.529749:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.529773:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460479.529831:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2380:x1875336462641280:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 199us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460479.529838:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00010000:00010000:3.0:1788460479.530467:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.530489:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460479.530683:0:7007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788460479.530830:0:7007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788460479.530890:0:7007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788460479.530977:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7007:1875336482587904:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788460479.531030:0:7007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460479.531292:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460479.531379:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482587904 00000100:00100000:1.0:1788460479.531387:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482587904 00000100:00100000:1.0:1788460479.531433:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460479.531442:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7007:x1875336482587904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788460479.531526:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7007:x1875336482587904:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460479.531534:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460479.531975:0:7007:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788460479.531983:0:7007:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650fd3c4e00, transno 4294967303 00000100:00100000:0.0:1788460479.532004:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7007:1875336482587904:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788460479.532608:0:7007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788460479.532668:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0205c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7007:1875336482588032:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788460479.532711:0:7007:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460479.533572:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482588032 00000100:00100000:1.0:1788460479.533581:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482588032 00000100:00100000:0.0:1788460479.533589:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460479.533769:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460479.533779:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7007:x1875336482588032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788460479.534222:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7007:x1875336482588032:12345-0@lo:1000:mdt00_003.0 Request processed in 443us (1508us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788460479.534231:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460479.534364:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0205c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7007:1875336482588032:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788460479.534399:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534409:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534417:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534438:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460479.534443:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534451:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534465:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:0.0:1788460479.534468:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460479.534472:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534478:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b77ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534517:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534523:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534529:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534533:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460479.534536:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534541:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534560:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:0.0:1788460479.534562:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460479.534566:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534576:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b76da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534597:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534610:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534619:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534647:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460479.534659:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 16 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460479.534671:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0205880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482588160:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460479.534785:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460479.540562:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.540640:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462641408 00000100:00100000:2.0:1788460479.540650:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462641408 00010000:00010000:2.0:1788460479.540688:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 17 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460479.540744:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1788460479.540754:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:2380:x1875336462641408:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460479.540767:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460479.540774:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 17 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.540787:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 17 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.540808:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:2.0:1788460479.540813:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.540823:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.540830:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460479.540849:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460479.541021:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:2380:x1875336462641408:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 268us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.541030:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00010000:00010000:0.0:1788460479.541626:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b76f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1351 expref: 16 pid: 5844 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460479.541646:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0205880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482588160:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460479.541678:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541767:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541774:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541787:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541793:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541800:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541806:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460479.541811:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541818:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541829:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:1.0:1788460479.541831:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460479.541843:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541849:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b77b3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541862:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541869:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541949:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541955:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460479.541958:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541964:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541973:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:1.0:1788460479.541975:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788460479.541978:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.541985:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460479.547062:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:10492:x1875336462641152:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 21905us (22345us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788460479.547078:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00000020:00080000:1.0:1788460479.547106:0:7007:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788460479.549591:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460479.549734:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462641664 00000100:00100000:1.0:1788460479.549744:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462641664 00000100:00100000:1.0:1788460479.549796:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1788460479.549806:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:10492:x1875336462641664:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788460479.550472:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788460479.550577:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788460479.550620:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.550636:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.550647:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.550655:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.550661:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.550666:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460479.550683:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788460479.550768:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:10492:x1875336462641664:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 962us (1184us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788460479.550778:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000020:00080000:1.0:1788460479.550782:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788460479.551019:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460479.551026:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.551033:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460479.551038:0:7658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.551046:0:7658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.551059:0:7658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9650c34d0200) 00010000:00010000:3.0:1788460479.551061:0:7658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788460479.551066:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.551071:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b77ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460479.551101:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460479.551103:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460479.551105:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460479.551792:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460479.551799:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460479.551846:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788460479.551853:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788460479.721393:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.721436:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.721519:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460479.721550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462642048 00000100:00100000:2.0:1788460479.721573:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462642048 00000100:00100000:2.0:1788460479.721624:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:2.0:1788460479.721634:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462642048:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460479.721695:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462642048:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460479.721703:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:3.0:1788460479.724015:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462641920 00000100:00100000:3.0:1788460479.724029:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462641920 00000100:00100000:3.0:1788460479.724107:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:3.0:1788460479.724117:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462641920:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460479.724221:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462641920:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 105us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460479.724228:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00080000:0.0:1788460479.724599:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460479.724604:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460479.725547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462641792 00000100:00100000:1.0:1788460479.725570:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462641792 00000100:00100000:1.0:1788460479.725628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 312 00000100:00100000:1.0:1788460479.725638:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462641792:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460479.725773:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3339850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462641792:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 136us (4336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460479.725780:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 312 00010000:00010000:3.0:1788460479.885635:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460480.913225:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460481.225727:0:12091:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460481.225737:0:12091:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460481.225771:0:12091:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788460481.225776:0:12091:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788460481.402236:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460481.402324:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462642304 00000100:00100000:3.0:1788460481.402334:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462642304 00000100:00100000:3.0:1788460481.402407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:3.0:1788460481.402417:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:10511:x1875336462642304:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460481.402441:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460481.402460:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b77c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1389 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788460481.402481:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460481.402553:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b77c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.402567:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b77c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.402587:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b77c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460481.402599:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788460481.402712:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b77c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1389 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.402730:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b77c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1389 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.402739:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460481.402742:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788460481.402745:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029ca00, rc 0) 00000100:00100000:3.0:1788460481.402809:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:10511:x1875336462642304:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 393us (584us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788460481.402817:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1788460481.409364:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.409542:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462642432 00000100:00100000:2.0:1788460481.409552:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462642432 00000100:00100000:2.0:1788460481.409610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:2.0:1788460481.409620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:10511:x1875336462642432:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:2.0:1788460481.409697:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.409714:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.409725:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.409740:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.409746:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.409753:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410007:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410023:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410031:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460481.410067:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410078:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410085:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410092:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410098:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460481.410101:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410108:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410118:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:2.0:1788460481.410121:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460481.410126:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410132:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b77d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410149:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410155:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410161:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410166:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460481.410169:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410175:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410222:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c3cb0b00) 00010000:00010000:2.0:1788460481.410225:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460481.410228:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410234:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b77dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410262:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410268:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410274:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410286:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460481.410289:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410295:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c3cb0300) 00010000:00010000:2.0:1788460481.410305:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460481.410309:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.410314:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b77e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460481.410393:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:10511:x1875336462642432:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 773us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460481.410401:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:0.0:1788460481.463890:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460481.468534:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462642688 00000100:00100000:1.0:1788460481.468552:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462642688 00000100:00100000:1.0:1788460481.468632:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:1.0:1788460481.468643:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:10514:x1875336462642688:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460481.468663:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460481.468684:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b77eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1390 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.468752:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.468768:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.468779:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.468794:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.468801:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.468826:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469278:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469288:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469295:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460481.469305:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788460481.469396:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469404:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469410:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469416:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460481.469424:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469431:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469441:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460481.469444:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460481.469455:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469461:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b77f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469475:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469481:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469486:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469490:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460481.469493:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469497:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469504:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c34d0a00) 00010000:00010000:1.0:1788460481.469505:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460481.469508:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469513:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b77f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469551:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b77eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 22 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469574:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 21 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.469581:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:1.0:1788460481.469583:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460481.469585:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5400, rc 0) 00000100:00100000:1.0:1788460481.469643:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10514:x1875336462642688:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1003us (5774us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788460481.469651:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:1.0:1788460481.477607:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.477715:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462642816 00000100:00100000:2.0:1788460481.477724:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462642816 00000100:00100000:2.0:1788460481.477983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:2.0:1788460481.478000:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10514:x1875336462642816:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1788460481.478065:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.478082:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.478094:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.488032:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.488051:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.488059:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.488066:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460481.488070:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.488078:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.488095:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:0.0:1788460481.488098:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460481.488103:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.488127:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b780e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460481.488264:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10514:x1875336462642816:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 10261us (10661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460481.488275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:0.0:1788460481.491088:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460481.491231:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462643072 00000100:00100000:1.0:1788460481.491242:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462643072 00000100:00100000:1.0:1788460481.491294:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1788460481.491304:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d286b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10514:x1875336462643072:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460481.491526:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d286b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:10514:x1875336462643072:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 223us (447us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788460481.491534:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1788460481.552541:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460481.552688:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462643328 00000100:00100000:3.0:1788460481.552698:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462643328 00000100:00100000:3.0:1788460481.552753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:3.0:1788460481.552763:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:10033:x1875336462643328:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460481.552787:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460481.552807:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7815 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1397 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.552913:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.552944:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 23 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.552951:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.552983:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 23 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.552997:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 23 pid: 7007 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460481.553011:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5872a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482588288:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460481.553108:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460481.557821:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5872a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482588288:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460481.557852:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460481.559944:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460481.562391:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462643456 00000100:00100000:3.0:1788460481.562405:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462643456 00010000:00010000:3.0:1788460481.562454:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 24 pid: 7007 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460481.562628:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1788460481.562639:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:2379:x1875336462643456:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460481.562653:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460481.562660:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 24 pid: 7007 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.562672:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 24 pid: 7007 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.562707:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7800 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1390 expref: 24 pid: 7007 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.562724:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:3.0:1788460481.562730:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.562739:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.562747:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.562781:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460481.562847:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:2379:x1875336462643456:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 209us (2911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460481.562855:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00010000:00010000:0.0:1788460481.562923:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.562932:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460481.562950:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788460481.563102:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7815 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.563118:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.563124:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:0.0:1788460481.563127:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460481.563130:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c600, rc 0) 00000100:00100000:0.0:1788460481.563156:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:10033:x1875336462643328:12345-192.168.203.32@tcp:101:bash.0 Request processed in 10395us (10634us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788460481.563169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:1.0:1788460481.571331:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460481.571381:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462643712 00000100:00100000:0.0:1788460481.571389:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462643712 00000100:00100000:0.0:1788460481.571434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:0.0:1788460481.571441:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:10033:x1875336462643712:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:0.0:1788460481.571726:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.571738:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.571747:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460481.571793:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788460481.571816:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026dfc8c4 reply state 000000006a321658 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460481.571905:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788460481.571993:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788460481.572096:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:10033:x1875336462643712:12345-192.168.203.32@tcp:36:bash.0 Request processed in 652us (772us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788460481.572103:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000020:00080000:0.0:1788460481.572108:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788460481.575632:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.575650:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.575658:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.575665:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460481.575669:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.575677:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.575694:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460481.575697:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460481.575701:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.575707:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b782a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460481.581155:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460481.581806:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462643840 00000100:00100000:3.0:1788460481.581818:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462643840 00000100:00100000:3.0:1788460481.581916:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:3.0:1788460481.581927:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:10033:x1875336462643840:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460481.581954:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460481.581973:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d139e expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.582035:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d139e expref: 27 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.582080:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d139e expref: 27 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.582100:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:3.0:1788460481.582104:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460481.582107:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029da00, rc 0) 00000100:00100000:3.0:1788460481.582175:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:10033:x1875336462643840:12345-192.168.203.32@tcp:101:bash.0 Request processed in 249us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460481.582213:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:1.0:1788460481.588159:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.588885:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462643968 00000100:00100000:2.0:1788460481.588896:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462643968 00000100:00080000:0.0:1788460481.588946:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460481.588975:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1788460481.588985:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:10033:x1875336462643968:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460481.589003:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460481.589023:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13a5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460481.589060:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a99bdbd, atime: 0x6a99bdbb, ctime: 0x6a99bdbd, blocks: 0xb 00010000:00010000:2.0:1788460481.589082:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1788460481.589087:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460481.589095:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.589113:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.589127:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009200, rc 0) 00000100:00100000:2.0:1788460481.589236:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:10033:x1875336462643968:12345-192.168.203.32@tcp:101:bash.0 Request processed in 253us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460481.589243:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1788460481.593581:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.593655:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462644096 00000100:00100000:2.0:1788460481.593665:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462644096 00002000:00010000:2.0:1788460481.593704:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788460481.593708:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0207800 with x1875336462644096 ext(0->18446744073709551615) 00002000:00010000:2.0:1788460481.593719:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650d0207800. 00000100:00100000:2.0:1788460481.593755:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1788460481.593764:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2382:x1875336462644096:12345-192.168.203.32@tcp:10:bash.0 00002000:00010000:2.0:1788460481.594020:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788460481.594024:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788460477 -> 1788460480 00002000:00010000:2.0:1788460481.594027:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788460475 -> 1788460475 00002000:00010000:2.0:1788460481.594030:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788460477 -> 1788460480 00002000:00010000:2.0:1788460481.594043:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788460481.594240:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2382:x1875336462644096:12345-192.168.203.32@tcp:10:bash.0 Request processed in 475us (667us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788460481.594249:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00002000:00010000:2.0:1788460481.594253:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788460481.594256:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0207800 with x1875336462644096 ext(0->18446744073709551615) 00002000:00010000:2.0:1788460481.594260:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650d0207800. 00000100:00100000:1.0:1788460481.676576:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.678072:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462644224 00000100:00100000:2.0:1788460481.678085:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462644224 00000100:00100000:2.0:1788460481.678146:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:2.0:1788460481.678156:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:10528:x1875336462644224:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:2.0:1788460481.678426:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678444:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678456:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678471:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678484:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678702:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678793:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460481.678830:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678841:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678847:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678862:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678868:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460481.678873:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678881:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678892:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:2.0:1788460481.678895:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460481.678900:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678906:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b783f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678925:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678932:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678938:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678943:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460481.678946:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678952:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678966:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460481.678968:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460481.678971:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678978:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.678993:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.679000:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.679006:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.679017:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460481.679021:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.679027:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.679036:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460481.679039:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460481.679042:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.679048:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b784d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460481.679129:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:10528:x1875336462644224:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 973us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460481.679138:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:1.0:1788460481.724415:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460481.724634:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462644480 00000100:00100000:0.0:1788460481.724644:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462644480 00000100:00100000:0.0:1788460481.724702:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:0.0:1788460481.724712:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:10531:x1875336462644480:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460481.724751:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460481.724773:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7854 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13ac expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.724850:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.724874:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.724885:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.724900:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.724907:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.724914:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725233:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725242:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725249:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460481.725259:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788460481.725349:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725356:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725362:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725368:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460481.725372:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725380:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725392:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460481.725395:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460481.725399:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725405:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b785b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725416:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725421:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725427:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.725431:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460481.725439:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.726006:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.726016:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650d2c3ca00) 00010000:00010000:0.0:1788460481.726019:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460481.726022:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.726028:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b7862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.726291:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ac expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.726306:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ac expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.726313:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:0.0:1788460481.726316:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788460481.726318:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b800, rc 0) 00000100:00100000:0.0:1788460481.726386:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:10531:x1875336462644480:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1675us (1981us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788460481.726395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:0.0:1788460481.733679:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.733817:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462644608 00000100:00100000:2.0:1788460481.733828:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462644608 00000100:00100000:2.0:1788460481.733884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:2.0:1788460481.733893:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:10531:x1875336462644608:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1788460481.733954:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.733969:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.733979:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.734274:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.734288:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460481.734301:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482588416:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460481.734373:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea50b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460481.737884:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.737912:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482588416:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460481.737946:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460481.739371:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462644864 00000100:00100000:3.0:1788460481.739383:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462644864 00000100:00100000:2.0:1788460481.739551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1788460481.739563:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:5618:x1875336462644864:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788460481.739677:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788460481.739687:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788460481.740697:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:5618:x1875336462644864:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 1131us (2818us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788460481.740707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:3.0:1788460481.743568:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460481.744165:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462644992 00000100:00100000:0.0:1788460481.744222:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462644992 00010000:00010000:0.0:1788460481.744263:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 31 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460481.744308:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:0.0:1788460481.744318:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:2380:x1875336462644992:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460481.744332:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460481.744339:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 31 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.744351:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 31 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.744373:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b781c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1397 expref: 31 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.744388:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:0.0:1788460481.744394:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.744405:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.744412:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.744453:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460481.744507:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:2380:x1875336462644992:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 190us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460481.744514:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00010000:00010000:3.0:1788460481.744835:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744844:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744880:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744887:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744893:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744909:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460481.744913:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744920:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744929:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:3.0:1788460481.744932:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460481.744935:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.744941:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460481.744991:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:10531:x1875336462644608:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 11099us (11321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460481.744999:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:3.0:1788460481.751839:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.752079:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462645248 00000100:00100000:2.0:1788460481.752087:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462645248 00000100:00100000:2.0:1788460481.752138:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1788460481.752147:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:10531:x1875336462645248:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460481.752393:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:10531:x1875336462645248:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 247us (566us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788460481.752401:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:0.0:1788460481.788465:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460481.788522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460481.788627:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462645376 00000100:00100000:3.0:1788460481.788637:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462645376 00002000:00100000:3.0:1788460481.788683:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9650d0206d80 x1875336462645376/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:637/0 lens 496/0 e 0 to 0 dl 1788460492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460481.788695:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0206d80 with x1875336462645376 ext(0->7) 00002000:00010000:3.0:1788460481.788701:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650d0206d80 00000100:00100000:3.0:1788460481.788732:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1788460481.788742:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2380:x1875336462645376:12345-192.168.203.32@tcp:4:bash.0 00000100:00100000:3.0:1788460481.789515:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2380:x1875336462645376:12345-192.168.203.32@tcp:4:bash.0 Request processed in 770us (1056us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788460481.789525:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00002000:00100000:3.0:1788460481.789532:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9650d0206d80 x1875336462645376/t4294967307(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:637/0 lens 496/448 e 0 to 0 dl 1788460492 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460481.789541:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0206d80 with x1875336462645376 ext(0->7) 00002000:00010000:3.0:1788460481.789545:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650d0206d80 00000100:00100000:1.0:1788460481.794074:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462645504 00000100:00100000:1.0:1788460481.794089:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462645504 00000100:00100000:1.0:1788460481.794162:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1788460481.794172:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2380:x1875336462645504:12345-192.168.203.32@tcp:16:kworker.0 00000100:00100000:1.0:1788460481.861084:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2380:x1875336462645504:12345-192.168.203.32@tcp:16:kworker.0 Request processed in 66892us (72544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460481.861096:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000001:00080000:2.0:1788460481.861230:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788460481.861240:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788460481.861244:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788460481.861250:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:2.0:1788460481.877714:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460481.877817:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462645760 00000100:00100000:1.0:1788460481.877826:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462645760 00000100:00100000:1.0:1788460481.877887:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:1.0:1788460481.877898:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+30:10542:x1875336462645760:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1788460481.877921:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460481.877941:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b787e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13b3 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878009:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878023:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878037:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878050:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878058:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878083:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878398:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878408:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878415:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460481.878425:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788460481.878503:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878511:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878518:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878524:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460481.878528:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878536:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878547:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460481.878550:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460481.878561:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878568:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878581:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878588:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878593:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878598:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460481.878600:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878606:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878613:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c34d0a00) 00010000:00010000:1.0:1788460481.878615:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460481.878618:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878623:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b788c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878665:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b787e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13b3 expref: 33 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878692:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13b3 expref: 32 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.878700:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:1.0:1788460481.878703:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460481.878705:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5a00, rc 0) 00000100:00100000:1.0:1788460481.878767:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:10542:x1875336462645760:12345-192.168.203.32@tcp:101:cat.0 Request processed in 871us (1063us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788460481.878774:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:0.0:1788460481.885126:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460481.885496:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462646016 00000100:00100000:1.0:1788460481.885595:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462646016 00000100:00100000:1.0:1788460481.885690:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:1.0:1788460481.885702:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:10542:x1875336462646016:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:1.0:1788460481.885964:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:10542:x1875336462646016:12345-192.168.203.32@tcp:35:cat.0 Request processed in 263us (846us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788460481.885972:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:1.0:1788460481.904480:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460481.904546:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462646272 00000100:00100000:0.0:1788460481.904556:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462646272 00000100:00100000:0.0:1788460481.904619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:0.0:1788460481.904629:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:10543:x1875336462646272:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:0.0:1788460481.904677:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788460481.904698:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13b3 expref: 33 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904715:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ac expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904725:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d139e expref: 31 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904733:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:0.0:1788460481.904740:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460481.904754:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904763:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904770:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904779:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904798:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.904803:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.905365:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.905376:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.905384:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460481.905931:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788460481.905941:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355141761209ns, next at 356141759371ns, rc = 0 00010000:00010000:0.0:1788460481.905999:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.906010:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.906018:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.906026:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.906046:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.906547:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906680:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460481.906709:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906717:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906724:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906740:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5bc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460481.906745:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906752:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906765:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:1.0:1788460481.906768:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788460481.906773:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906779:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b78af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906798:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906804:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906810:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906814:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460481.906817:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906823:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906840:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460481.906842:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460481.906845:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.906851:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b78a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460481.906861:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000958ad6fc reply state 0000000089959c2d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460481.906869:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788460481.906891:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460481.906901:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.906907:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460481.906910:0:7659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.906916:0:7659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.906924:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9650d2c3ca00) 00010000:00010000:3.0:1788460481.906927:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788460481.906930:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.906935:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b78b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.906951:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460481.906953:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460481.906955:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460481.906981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:10543:x1875336462646272:12345-192.168.203.32@tcp:36:rm.0 Request processed in 2350us (2508us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788460481.906991:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 95 00010000:00010000:0.0:1788460481.909286:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.909303:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.909311:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.909317:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460481.909322:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.909329:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.909345:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650d2c3c100) 00010000:00010000:0.0:1788460481.909349:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460481.909353:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.909364:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b78a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.932503:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460481.960013:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460481.960503:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462646528 00000100:00100000:3.0:1788460481.960514:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462646528 00000100:00100000:3.0:1788460481.960967:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:3.0:1788460481.960979:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:10549:x1875336462646528:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460481.961006:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460481.961025:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b78bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13ba expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.961263:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.961279:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.961289:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.961303:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.961309:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.961315:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460481.962711:0:7007:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788460481.963542:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963560:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963581:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963621:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963628:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963635:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963640:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460481.963644:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963651:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963662:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460481.963664:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460481.963669:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963674:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460481.963686:0:7007:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003891f7a7 reply state 00000000d5ed42c9 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460481.963693:0:7007:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788460481.963726:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b78bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 34 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963740:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 33 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460481.963747:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460481.963749:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460481.963751:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029da00, rc 0) 00000100:00100000:2.0:1788460481.964955:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:10549:x1875336462646528:12345-192.168.203.32@tcp:101:bash.0 Request processed in 3971us (4945us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788460481.964966:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:2.0:1788460481.971711:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460481.972072:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462646656 00000100:00100000:1.0:1788460481.972082:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462646656 00000100:00100000:1.0:1788460481.972149:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1788460481.972160:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462646656:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460481.972205:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460481.972226:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13c1 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460481.972251:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460481.972268:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1788460481.972272:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460481.972281:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.972311:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460481.972324:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4000, rc 0) 00000100:00100000:1.0:1788460481.972377:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2380:x1875336462646656:12345-192.168.203.32@tcp:101:bash.0 Request processed in 219us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460481.972384:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00080000:2.0:1788460481.972545:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788460481.973366:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.973379:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.973396:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.973403:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ce00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460481.973408:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.973416:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.973430:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c52ed900) 00010000:00010000:0.0:1788460481.973433:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460481.973439:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460481.973445:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b78cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460481.984429:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460481.984516:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462646784 00000100:00100000:2.0:1788460481.984532:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462646784 00000100:00100000:2.0:1788460481.984585:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:2.0:1788460481.984594:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:10549:x1875336462646784:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460481.984612:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460481.984628:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13c8 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.984661:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.984670:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460481.984674:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460481.984679:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.984710:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 9 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460481.984741:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 9 pid: 6699 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460481.984755:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875336482588544:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460481.985314:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460482.004915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.005158:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462646912 00000100:00100000:3.0:1788460482.005168:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462646912 00000100:00100000:2.0:1788460482.005511:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875336482588544:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460482.005557:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.005587:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460482.005645:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:10549:x1875336462646784:12345-192.168.203.32@tcp:101:bash.0 Request processed in 21052us (21226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.005653:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00010000:00010000:0.0:1788460482.006969:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 9 pid: 6699 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460482.007209:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:0.0:1788460482.007224:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2379:x1875336462646912:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460482.007238:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460482.007259:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 9 pid: 6699 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.007292:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 9 pid: 6699 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.007312:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b78e0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c1 expref: 9 pid: 6699 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.007329:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460482.007333:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460482.007341:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.007351:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.007386:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460482.007400:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0204700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875336482588672:192.168.203.32@tcp:105: 00000100:00100000:0.0:1788460482.007494:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c93af840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460482.024344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.024758:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462647168 00000100:00100000:3.0:1788460482.024768:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462647168 00000100:00100000:3.0:1788460482.024834:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1788460482.024844:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:10549:x1875336462647168:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:3.0:1788460482.025239:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:10549:x1875336462647168:12345-192.168.203.32@tcp:35:bash.0 Request processed in 394us (902us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788460482.025247:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1788460482.033759:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0204700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875336482588672:192.168.203.32@tcp:105: 00010000:00010000:2.0:1788460482.033787:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460482.034404:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462646912:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 27182us (29495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.034415:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460482.060537:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482589184:0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.060617:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460482.060671:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788460482.060678:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482588800:0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.060719:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460482.060752:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482589312:0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.060778:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460482.060805:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482588928:0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.060828:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460482.060842:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482589440:0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.060862:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460482.060881:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460482.060886:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482589056:0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.060906:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460482.060937:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482588800 00000100:00100000:2.0:1788460482.060944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482588800 00000100:00100000:2.0:1788460482.060986:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788460482.060994:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482588800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.061061:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482588800:12345-0@lo:400:kworker.0 Request processed in 67us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.061335:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482589184 00000100:00100000:3.0:1788460482.061340:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482589184 00000100:00100000:3.0:1788460482.061375:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482589440 00000100:00100000:3.0:1788460482.061378:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482589440 00000100:00100000:3.0:1788460482.061398:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460482.061406:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482589184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.061445:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482589184:12345-0@lo:400:kworker.0 Request processed in 40us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.061452:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460482.061467:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460482.061482:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482589440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.061516:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482589440:12345-0@lo:400:kworker.0 Request processed in 34us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.061522:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460482.061540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482589312 00000100:00100000:3.0:1788460482.061543:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482589312 00000100:00100000:3.0:1788460482.061579:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482588928 00000100:00100000:3.0:1788460482.061582:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482588928 00000100:00100000:3.0:1788460482.061594:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482589056 00000100:00100000:3.0:1788460482.061596:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482589056 00000100:00100000:3.0:1788460482.061610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788460482.061616:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482589312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.061649:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482589312:12345-0@lo:400:kworker.0 Request processed in 32us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.061655:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788460482.061666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788460482.061672:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482588928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.061695:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482588928:12345-0@lo:400:kworker.0 Request processed in 24us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.061701:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788460482.061710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788460482.061716:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482589056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.061739:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482589056:12345-0@lo:400:kworker.0 Request processed in 24us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.061745:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788460482.061780:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460482.061785:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460482.061794:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460482.062521:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482588800:0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.062539:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482589312:0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.062551:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482589184:0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.062817:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482589056:0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.062830:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482588928:0@lo:400:kworker.0 00000100:00100000:3.0:1788460482.062840:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788460482.062844:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1788460482.062861:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482589440:0@lo:400:kworker.0 00000100:00100000:2.0:1788460482.063244:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788460482.064695:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460482.064716:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482589568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460482.064777:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460482.065498:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482589568 00000100:00100000:2.0:1788460482.065505:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482589568 00000100:00100000:3.0:1788460482.065907:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788460482.065923:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482589696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460482.065967:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460482.066016:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482589696 00000100:00100000:3.0:1788460482.066020:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482589696 00000100:00100000:2.0:1788460482.066210:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460482.066221:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482589568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460482.066254:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460482.066303:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482589568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.066309:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460482.066356:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482589568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460482.069135:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788460482.070114:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482589696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460482.072378:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788460482.072844:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482589696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3678us (6872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.072964:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482589696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460482.073040:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000001:00080000:3.0:1788460482.122872:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:3.0:1788460482.122889:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1788460482.122893:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1788460482.214073:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.216539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462647296 00000100:00100000:3.0:1788460482.216555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462647296 00000100:00100000:3.0:1788460482.216631:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:3.0:1788460482.216641:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:10565:x1875336462647296:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460482.216663:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460482.216682:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b78ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13cf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.216761:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.216775:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.216786:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460482.216819:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788460482.216823:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460482.216840:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.216864:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b78ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13cf expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.216891:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13cf expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.216899:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460482.216902:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460482.216906:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c800, rc 0) 00000100:00100000:3.0:1788460482.216971:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:10565:x1875336462647296:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 332us (2908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.216978:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:3.0:1788460482.219942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460482.220694:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462647552 00000100:00100000:2.0:1788460482.220704:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462647552 00000100:00100000:2.0:1788460482.220769:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:2.0:1788460482.220779:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:10565:x1875336462647552:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460482.220800:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460482.220820:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b78fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13d6 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.220926:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.220941:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.220953:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460482.220964:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788460482.221099:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b78fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13d6 expref: 38 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.221119:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13d6 expref: 37 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.221146:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:2.0:1788460482.221149:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460482.221153:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009a00, rc 0) 00000100:00100000:2.0:1788460482.221273:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:10565:x1875336462647552:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 495us (1340us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788460482.221281:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:1.0:1788460482.227371:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460482.229284:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462647680 00000100:00100000:0.0:1788460482.229298:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462647680 00000100:00100000:0.0:1788460482.229453:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:0.0:1788460482.229465:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:2380:x1875336462647680:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460482.229482:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460482.229505:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13d6 expref: 37 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.229524:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:0.0:1788460482.229528:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460482.229590:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:2380:x1875336462647680:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 127us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460482.229597:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1788460482.234766:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.235396:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462647936 00000100:00100000:1.0:1788460482.235407:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462647936 00000100:00100000:1.0:1788460482.235465:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:1.0:1788460482.235476:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:10565:x1875336462647936:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460482.235499:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460482.235517:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7911 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13dd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.235609:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7918 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.235623:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.235634:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460482.235656:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788460482.235818:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7911 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13dd expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.235838:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7918 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13dd expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.235846:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:1.0:1788460482.235849:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788460482.235862:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4400, rc 0) 00000100:00100000:1.0:1788460482.235926:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:10565:x1875336462647936:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 448us (1166us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788460482.235933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:3.0:1788460482.243036:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460482.243109:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462648064 00000100:00100000:0.0:1788460482.243120:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462648064 00000100:00100000:0.0:1788460482.243223:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:0.0:1788460482.243233:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462648064:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:0.0:1788460482.243276:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.243295:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.243304:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460482.243308:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460482.243312:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.243344:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.243372:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 6 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460482.243387:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d0206a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8864:1875336482589824:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460482.243484:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460482.249375:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460482.249516:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462648192 00000100:00100000:2.0:1788460482.249526:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462648192 00002000:00100000:2.0:1788460482.249577:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9650d0205f80 x1875336462648192/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:638/0 lens 504/0 e 0 to 0 dl 1788460493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460482.249590:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0205f80 with x1875336462648192 ext(0->8) 00010000:00010000:2.0:1788460482.249600:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 7 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460482.249603:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d0206a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8864:1875336482589824:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460482.249625:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 7 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.249634:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460482.249635:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650d0205f80 00000100:00100000:2.0:1788460482.249665:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1788460482.249676:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462648192:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:2.0:1788460482.254974:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2379:x1875336462648192:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 5289us (5597us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788460482.254999:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00002000:00100000:2.0:1788460482.255020:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9650d0205f80 x1875336462648192/t4294967302(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:638/0 lens 504/448 e 0 to 0 dl 1788460493 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460482.255052:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650d0205f80 with x1875336462648192 ext(0->8) 00010000:00010000:2.0:1788460482.255062:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 9 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.255079:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 9 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460482.255087:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650d0205f80 00000100:00100000:3.0:1788460482.261684:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.261915:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462648320 00000100:00100000:1.0:1788460482.261924:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462648320 00010000:00010000:1.0:1788460482.261963:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 9 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.262140:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:1.0:1788460482.262151:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2380:x1875336462648320:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460482.262167:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788460482.262227:0:7669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788460482.262230:0:7669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788460481 00002000:00010000:1.0:1788460482.262233:0:7669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788460481 00002000:00010000:1.0:1788460482.262235:0:7669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788460481 00010000:00010000:1.0:1788460482.262242:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 9 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.262271:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 9 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.262295:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b78e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13c8 expref: 9 pid: 6701 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.262311:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460482.262315:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460482.262321:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.262464:0:7669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.262506:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460482.262552:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2380:x1875336462648320:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 403us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460482.262559:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00010000:00010000:3.0:1788460482.263050:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263117:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263146:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263155:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263163:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263170:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460482.263174:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263218:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263242:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.263249:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b591243/0x889bb893541b7926 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460482.263318:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462648064:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 20085us (20782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.263464:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:3.0:1788460482.267601:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.267680:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462648576 00000100:00100000:1.0:1788460482.267690:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462648576 00000100:00100000:1.0:1788460482.267744:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:1.0:1788460482.267755:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2869050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:10565:x1875336462648576:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:1.0:1788460482.267815:0:12105:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7918 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13dd expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788460482.268116:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788460482.268162:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788460482.268525:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788460482.268578:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.268592:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 42 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.268601:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.268634:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 42 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.268648:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 42 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.268662:0:12105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12105:1875336482589952:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460482.268736:0:12105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c1254540 going to sleep for 11 seconds 00000100:00100000:1.0:1788460482.284552:0:12105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12105:1875336482589952:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460482.284581:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460482.289848:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460482.290313:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462648704 00000100:00100000:2.0:1788460482.290323:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462648704 00010000:00010000:2.0:1788460482.290361:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 43 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460482.290403:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:2.0:1788460482.290411:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:2380:x1875336462648704:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460482.290424:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460482.290430:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 43 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.290443:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 43 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.290463:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b78d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13ba expref: 43 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.290480:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:2.0:1788460482.290499:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.290508:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.290514:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.290544:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460482.290601:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460482.290604:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+42:2380:x1875336462648704:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 192us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.290618:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00010000:00010000:1.0:1788460482.290620:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788460482.290772:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788460482.290986:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788460482.291126:0:12105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482590080:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788460482.291273:0:12105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460482.291324:0:12105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4edc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460482.291376:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482590080 00000100:00100000:3.0:1788460482.291382:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482590080 00000100:00100000:3.0:1788460482.291472:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460482.291481:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12105:x1875336482590080:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788460482.291554:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12105:x1875336482590080:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 74us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.291562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460482.291574:0:12105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788460482.291581:0:12105:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788460482.291601:0:12105:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650d0a3ea00, transno 4294967301 00000100:00100000:1.0:1788460482.294020:0:12105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482590080:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788460482.294692:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788460482.294770:0:12105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482590208:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788460482.294830:0:12105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460482.294864:0:12105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460482.294916:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482590208 00000100:00100000:2.0:1788460482.294924:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482590208 00000100:00100000:2.0:1788460482.294972:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460482.294981:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12105:x1875336482590208:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788460482.295170:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12105:x1875336482590208:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 189us (338us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788460482.295204:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460482.296228:0:12105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482590208:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788460482.296473:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788460482.296535:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.296546:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.296554:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.296561:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460482.296565:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.296588:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.296602:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:1.0:1788460482.296605:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788460482.296609:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.296615:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b792d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788460482.307375:0:12105:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788460482.311244:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788460482.311267:0:12105:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355547086888ns, next at 356547082242ns, rc = 0 00000001:00080000:1.0:1788460482.311285:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788460482.311352:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:1.0:1788460482.311356:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788460482.311367:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7918 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13dd expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.311487:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2869050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:10565:x1875336462648576:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 43733us (43895us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788460482.311497:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000020:00080000:1.0:1788460482.311503:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788460482.315347:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460482.315441:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462648832 00000100:00100000:2.0:1788460482.315451:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462648832 00000100:00100000:2.0:1788460482.315506:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:2.0:1788460482.315516:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:10565:x1875336462648832:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460482.315545:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460482.315568:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7934 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13e4 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.315629:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13e4 expref: 46 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.315658:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13e4 expref: 46 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.315679:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460482.315683:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460482.315686:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008a00, rc 0) 00000100:00100000:2.0:1788460482.315753:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+46:10565:x1875336462648832:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 235us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.315766:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:0.0:1788460482.330929:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460482.335751:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462649088 00000100:00100000:2.0:1788460482.335765:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462649088 00000100:00100000:2.0:1788460482.335837:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:2.0:1788460482.335848:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+46:10565:x1875336462649088:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460482.336160:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:10565:x1875336462649088:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 313us (5239us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788460482.336168:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1788460482.445106:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460482.445417:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462649216 00000100:00100000:0.0:1788460482.445428:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462649216 00000100:00100000:0.0:1788460482.445490:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:0.0:1788460482.445509:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:10575:x1875336462649216:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1788460482.445583:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445599:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445610:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445625:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445632:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445638:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445735:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445745:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445751:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460482.445793:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445805:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445811:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445818:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445825:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460482.445828:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445836:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445848:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460482.445851:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460482.445856:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445870:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b793b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445884:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445890:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445910:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445915:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460482.445918:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445924:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445932:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650d2c3c900) 00010000:00010000:0.0:1788460482.445935:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460482.445938:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445943:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445958:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445965:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445978:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445984:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460482.445987:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.445993:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.446014:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460482.446017:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460482.446020:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.446026:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7949 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460482.446104:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:10575:x1875336462649216:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 605us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460482.446112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:2.0:1788460482.528113:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.528289:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462649472 00000100:00100000:3.0:1788460482.528300:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462649472 00000100:00100000:3.0:1788460482.528408:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:3.0:1788460482.528418:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:10578:x1875336462649472:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460482.528438:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460482.528466:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7950 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13eb expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528549:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528563:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528574:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528588:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528595:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528601:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528713:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528722:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.528730:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460482.528739:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788460482.528833:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.529975:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.529988:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.529995:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460482.529999:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530007:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530029:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460482.530032:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460482.530037:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530045:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7957 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530060:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530066:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530071:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530076:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460482.530089:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530095:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530103:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c52ed200) 00010000:00010000:3.0:1788460482.530105:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460482.530108:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530113:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b795e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.530164:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7950 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 50 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.531260:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 49 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.531277:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:3.0:1788460482.531279:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460482.531283:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c200, rc 0) 00000100:00100000:3.0:1788460482.531453:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+49:10578:x1875336462649472:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 3033us (3348us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788460482.531461:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:3.0:1788460482.545053:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460482.545227:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462649600 00000100:00100000:0.0:1788460482.545236:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462649600 00000100:00100000:0.0:1788460482.545295:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:0.0:1788460482.545305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+49:10578:x1875336462649600:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1788460482.545367:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545383:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545408:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545436:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545443:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545450:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545455:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460482.545460:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545466:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545477:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460482.545479:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460482.545484:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.545489:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7973 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460482.545688:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+49:10578:x1875336462649600:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 383us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460482.545697:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:0.0:1788460482.549163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.549357:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462649856 00000100:00100000:1.0:1788460482.549367:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462649856 00000100:00100000:1.0:1788460482.549426:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:1.0:1788460482.549436:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+49:10578:x1875336462649856:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460482.549700:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:10578:x1875336462649856:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 265us (545us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788460482.549709:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:2.0:1788460482.632378:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.632441:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462650112 00000100:00100000:1.0:1788460482.632451:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462650112 00000100:00100000:1.0:1788460482.632510:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:1.0:1788460482.632521:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:10588:x1875336462650112:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460482.632545:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460482.632548:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788460482.632572:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b78f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13cf expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.632591:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460482.632595:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460482.632677:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b797a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13f2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.632766:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.632781:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 50 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.632790:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.632822:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 50 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.632924:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 50 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.632941:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482590336:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460482.633136:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c93af840 going to sleep for 11 seconds 00000040:00080000:0.0:1788460482.636468:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460482.636477:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460482.636509:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788460482.636516:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460482.639632:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482590336:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460482.639661:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460482.641484:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.642583:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462650240 00000100:00100000:1.0:1788460482.642594:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462650240 00010000:00010000:1.0:1788460482.642644:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 51 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.642689:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1788460482.642699:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:2379:x1875336462650240:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460482.642713:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460482.642720:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 51 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.642733:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 51 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.642759:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13eb expref: 51 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.642793:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:1.0:1788460482.642798:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.642807:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.642814:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.642848:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460482.642899:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:2379:x1875336462650240:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 201us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460482.642907:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00010000:00010000:3.0:1788460482.642983:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.643001:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460482.643028:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788460482.643169:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b797a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.643219:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.643237:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:3.0:1788460482.643240:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788460482.643243:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4a00, rc 0) 00000100:00100000:3.0:1788460482.643268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:10588:x1875336462650112:12345-192.168.203.32@tcp:101:bash.0 Request processed in 10749us (10899us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788460482.643275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:0.0:1788460482.652316:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.652597:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462650496 00000100:00100000:3.0:1788460482.652607:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462650496 00000100:00100000:3.0:1788460482.652713:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:3.0:1788460482.652725:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:10588:x1875336462650496:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:3.0:1788460482.653050:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.653067:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.653078:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460482.653149:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788460482.653505:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c32e1eb reply state 00000000ec8f802b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460482.653515:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460482.653612:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10588:x1875336462650496:12345-192.168.203.32@tcp:36:bash.0 Request processed in 888us (1301us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788460482.653620:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 105 00000020:00080000:3.0:1788460482.653625:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788460482.656058:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1788460482.656063:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.656074:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.656082:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.656088:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460482.656093:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.656101:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.656134:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:1.0:1788460482.656137:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460482.656142:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.656149:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b798f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460482.656208:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462650624 00000100:00100000:3.0:1788460482.656218:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462650624 00000100:00100000:3.0:1788460482.656279:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:3.0:1788460482.656289:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:10588:x1875336462650624:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460482.656310:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460482.656325:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7996 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d13f9 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.656397:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.656409:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.656416:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.656445:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.656471:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 53 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460482.656484:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482590464:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460482.656548:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5900 going to sleep for 11 seconds 00000100:00100000:2.0:1788460482.659326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.659477:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482590464:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460482.659503:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460482.659588:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462650752 00000100:00100000:0.0:1788460482.659596:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462650752 00010000:00010000:0.0:1788460482.659628:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 54 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460482.659655:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1788460482.659663:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:2379:x1875336462650752:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460482.659676:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460482.659682:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 54 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.659692:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 54 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.659712:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7981 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f2 expref: 54 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.659725:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460482.659729:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.659738:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.659758:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.659793:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460482.659848:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:2379:x1875336462650752:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 186us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460482.659856:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00010000:00010000:2.0:1788460482.659943:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.659951:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460482.660004:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788460482.660009:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460482.660028:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.660057:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7996 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 53 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.660078:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 52 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.660086:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460482.660088:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460482.660091:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029cc00, rc 0) 00000100:00100000:2.0:1788460482.660130:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:10588:x1875336462650624:12345-192.168.203.32@tcp:101:bash.0 Request processed in 3843us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.660137:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:2.0:1788460482.664076:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.664151:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462651008 00000100:00100000:3.0:1788460482.664162:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462651008 00000100:00100000:3.0:1788460482.664265:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:3.0:1788460482.664277:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:10588:x1875336462651008:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:3.0:1788460482.664494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10588:x1875336462651008:12345-192.168.203.32@tcp:35:bash.0 Request processed in 219us (433us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788460482.664501:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:0.0:1788460482.728697:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.728795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462651136 00000100:00100000:1.0:1788460482.728808:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462651136 00000100:00100000:1.0:1788460482.728879:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:1.0:1788460482.728890:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:10594:x1875336462651136:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460482.728919:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460482.728941:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b79a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1400 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.729001:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b79ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.729015:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b79ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.729027:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b79ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460482.729077:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788460482.729081:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460482.729096:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b79ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.729138:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b79a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1400 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.729157:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b79ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1400 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.729165:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460482.729168:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460482.729171:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5000, rc 0) 00000100:00100000:1.0:1788460482.729289:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10594:x1875336462651136:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 400us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460482.729296:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:1.0:1788460482.733899:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.733978:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462651264 00000100:00100000:3.0:1788460482.733988:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462651264 00000100:00100000:3.0:1788460482.734060:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:3.0:1788460482.734079:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10594:x1875336462651264:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460482.734098:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460482.734117:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1407 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734176:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734245:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734257:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734282:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734289:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734296:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734376:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734384:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734391:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460482.734425:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788460482.734429:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460482.734446:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734456:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734476:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734482:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734489:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734495:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460482.734500:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734507:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734519:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:3.0:1788460482.734522:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460482.734526:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734532:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b79b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734545:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734551:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734557:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734569:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029dc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460482.734572:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734578:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734585:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c52ed500) 00010000:00010000:3.0:1788460482.734587:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460482.734590:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734596:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b79c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734626:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734639:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.734645:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:3.0:1788460482.734647:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460482.734650:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460482.734698:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10594:x1875336462651264:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 623us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.734704:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:0.0:1788460482.738894:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.738994:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462651520 00000100:00100000:1.0:1788460482.739014:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462651520 00000100:00100000:1.0:1788460482.739507:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:1.0:1788460482.739520:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10594:x1875336462651520:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460482.739540:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460482.739559:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b79ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d140e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.739656:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.739671:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 56 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.739696:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.739704:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.739739:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.739753:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 56 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.739768:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482590592:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460482.739858:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 56 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.739868:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 56 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.739876:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482590720:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460482.739899:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c93af840 going to sleep for 11 seconds 00000100:00100000:0.0:1788460482.742423:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460482.743728:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462651648 00000100:00100000:1.0:1788460482.743740:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462651648 00010000:00010000:1.0:1788460482.743787:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 57 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460482.743893:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1788460482.743903:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:2381:x1875336462651648:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460482.743918:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460482.743925:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 57 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.743938:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 57 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.743959:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:1.0:1788460482.743964:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.743974:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460482.743979:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460482.744056:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:2381:x1875336462651648:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 154us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460482.744071:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1788460482.746136:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:3.0:1788460482.746249:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.32@tcp) returned -22 from blocking AST (req@00000000f36f637a x1875336482590592) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 56 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.746281:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b79c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1407 expref: 56 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460482.746297:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482590592:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460482.746312:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482590720:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460482.746337:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:3.0:1788460482.746343:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.746352:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.746362:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460482.747619:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462651776 00000100:00100000:2.0:1788460482.747631:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462651776 00010000:00010000:2.0:1788460482.747673:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 56 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460482.747714:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:2.0:1788460482.747724:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0204700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:2380:x1875336462651776:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460482.747737:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460482.747743:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 56 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.747763:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 56 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.747783:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b799d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13f9 expref: 56 pid: 7007 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.747794:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460482.747799:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.747807:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.747814:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.747836:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460482.747883:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0204700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:2380:x1875336462651776:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 160us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.747891:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00010000:00010000:2.0:1788460482.747916:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.747923:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460482.747942:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788460482.749305:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b79ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.749347:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.749355:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460482.749358:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460482.749361:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5a00, rc 0) 00000100:00100000:2.0:1788460482.749465:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10594:x1875336462651520:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 9948us (10581us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788460482.749473:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:0.0:1788460482.759696:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460482.765823:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462652032 00000100:00100000:2.0:1788460482.765838:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462652032 00000100:00100000:2.0:1788460482.765909:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1788460482.765919:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10594:x1875336462652032:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:2.0:1788460482.765933:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460482.765957:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13e4 expref: 55 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460482.765976:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460482.765981:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460482.766867:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10594:x1875336462652032:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 140us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460482.766883:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:0.0:1788460482.768247:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460482.768349:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462652160 00000100:00100000:3.0:1788460482.768358:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462652160 00000100:00100000:3.0:1788460482.768409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:3.0:1788460482.768419:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10594:x1875336462652160:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:3.0:1788460482.768512:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.768528:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460482.768540:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460482.768741:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788460482.768815:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10594:x1875336462652160:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 397us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460482.768824:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:3.0:1788460482.771337:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460482.771428:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462652288 00000100:00100000:0.0:1788460482.771437:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462652288 00000100:00100000:0.0:1788460482.771487:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:0.0:1788460482.771496:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:10594:x1875336462652288:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460482.771516:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460482.771535:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1415 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.771592:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.771603:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.771632:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.771664:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.771677:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460482.771680:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460482.771683:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460482.771690:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a000, rc 0) 00000100:00100000:0.0:1788460482.771750:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10594:x1875336462652288:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 254us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460482.771756:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 111 00010000:00010000:3.0:1788460482.956382:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460483.663240:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460483.663252:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460483.663300:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788460483.663308:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460483.664040:0:11722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482590848:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460483.664343:0:11722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460483.678582:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.679071:0:11722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482590848:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460483.679595:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462652416 00000100:00100000:3.0:1788460483.680155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462652416 00000100:00100000:3.0:1788460483.680302:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:3.0:1788460483.680315:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10595:x1875336462652416:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460483.680359:0:5842:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1788460483.680972:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460483.681748:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10595:x1875336462652416:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 1426us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460483.681765:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:1.0:1788460483.685296:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.685779:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462652544 00000100:00100000:0.0:1788460483.685796:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462652544 00000100:00100000:0.0:1788460483.685884:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:0.0:1788460483.685906:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10595:x1875336462652544:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788460483.686008:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.686051:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.686067:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.689818:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.689849:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.689862:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.689898:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.689907:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.689913:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460483.689960:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788460483.689965:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460483.689977:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.689989:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690016:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690022:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690028:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.690033:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690040:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690051:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:0.0:1788460483.690054:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460483.690059:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690065:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b79f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690081:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690086:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690092:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690097:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5bc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.690106:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690113:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690121:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9650d2c3c900) 00010000:00010000:0.0:1788460483.690123:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460483.690126:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690133:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b79f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690149:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690154:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690160:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690164:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.690167:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690173:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690207:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460483.690209:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460483.690217:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.690223:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b79ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.690307:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10595:x1875336462652544:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 4401us (5016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460483.690324:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1788460483.694163:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.699010:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462652800 00000100:00100000:0.0:1788460483.699027:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462652800 00000100:00100000:1.0:1788460483.703705:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:1.0:1788460483.703721:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:10595:x1875336462652800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460483.703745:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460483.703779:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7a06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d141c expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.703894:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.703910:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.703923:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460483.703934:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788460483.704331:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704340:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704346:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704353:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460483.704357:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704365:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704377:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:1.0:1788460483.704380:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788460483.704384:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704402:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704450:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7a06 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d141c expref: 57 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704462:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:1.0:1788460483.704464:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460483.704469:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7a06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d141c expref: 57 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.704480:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4000, rc 0) 00000100:00100000:1.0:1788460483.704558:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:10595:x1875336462652800:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 841us (10404us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788460483.704566:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:3.0:1788460483.717162:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.717548:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462652928 00000100:00100000:2.0:1788460483.717560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462652928 00000100:00100000:2.0:1788460483.717625:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:2.0:1788460483.717635:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:10595:x1875336462652928:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460483.717672:0:5843:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788460483.717787:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:10595:x1875336462652928:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 153us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460483.717795:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:2.0:1788460483.727932:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460483.728093:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462653184 00000100:00100000:1.0:1788460483.728104:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462653184 00000100:00100000:1.0:1788460483.728224:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:1.0:1788460483.728236:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:10595:x1875336462653184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460483.728257:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460483.728260:0:7007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788460483.728285:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b79ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1400 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.728304:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460483.728310:0:7007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460483.728335:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1423 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788460483.728725:0:7007:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788460483.729104:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7a22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.729121:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.729132:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.729255:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7a1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1423 expref: 58 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.729274:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7a22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1423 expref: 57 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.729282:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c34d0500) 00010000:00010000:1.0:1788460483.729285:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460483.729287:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5800, rc 0) 00000100:00100000:1.0:1788460483.729347:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:10595:x1875336462653184:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1113us (1425us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788460483.729356:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:1.0:1788460483.739216:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.739298:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462653440 00000100:00100000:0.0:1788460483.739308:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462653440 00000100:00100000:0.0:1788460483.739371:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:0.0:1788460483.739381:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:10595:x1875336462653440:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788460483.739436:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460483.739462:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7a22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1423 expref: 57 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739480:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c34d0500) 00010000:00010000:0.0:1788460483.739489:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460483.739508:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739521:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739530:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739545:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739571:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739581:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739660:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739667:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739674:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739680:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5bc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.739683:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739690:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739708:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:0.0:1788460483.739711:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460483.739715:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739721:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739732:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739744:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739750:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739755:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.739759:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739765:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739774:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x20eeb289 (ffff9650d2c3c900) 00010000:00010000:0.0:1788460483.739776:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460483.739779:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.739784:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x20eeb289 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.740015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:10595:x1875336462653440:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 634us (807us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460483.740023:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:1.0:1788460483.746200:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.746291:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462653568 00000100:00100000:2.0:1788460483.746301:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462653568 00000100:00100000:2.0:1788460483.746365:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:2.0:1788460483.746375:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:10595:x1875336462653568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460483.746397:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460483.746421:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7a3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d142a expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.746456:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.746468:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.746479:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.746573:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7a3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 58 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.746792:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 57 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.746802:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460483.746805:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460483.746808:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009a00, rc 0) 00000100:00100000:2.0:1788460483.746937:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:10595:x1875336462653568:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 563us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460483.746945:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:1.0:1788460483.752436:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.752524:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462653824 00000100:00100000:0.0:1788460483.752535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462653824 00000100:00100000:0.0:1788460483.752595:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:0.0:1788460483.752711:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:10595:x1875336462653824:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788460483.752790:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.752832:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.752844:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460483.753091:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788460483.753102:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356988922605ns, next at 357988920215ns, rc = 0 00000004:00010000:0.0:1788460483.753222:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca56eb3e reply state 000000006b7272f8 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.753232:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460483.753327:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:10595:x1875336462653824:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 620us (899us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788460483.756673:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.757291:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462653952 00000100:00100000:2.0:1788460483.757301:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462653952 00000100:00100000:2.0:1788460483.757348:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:2.0:1788460483.757358:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:10595:x1875336462653952:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460483.757382:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460483.757400:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1431 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.757458:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.757471:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.757490:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460483.757494:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460483.757506:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009c00, rc 0) 00000100:00100000:2.0:1788460483.757561:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:10595:x1875336462653952:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 204us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460483.757568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00010000:00010000:3.0:1788460483.757740:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.757750:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.757757:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.757763:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460483.757767:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.757785:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.757796:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460483.757798:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788460483.757803:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.757809:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7a4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460483.760847:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.761018:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:2.0:1788460483.761221:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462654080 00000100:00100000:2.0:1788460483.761231:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462654080 00000100:00100000:2.0:1788460483.761291:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:2.0:1788460483.761302:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462654080:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788460483.761626:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462654080:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 325us (787us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788460483.761634:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00080000:3.0:1788460483.762678:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460483.764280:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.764411:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462654336 00000100:00100000:2.0:1788460483.764420:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462654336 00000100:00100000:2.0:1788460483.764474:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:2.0:1788460483.764483:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:10595:x1875336462654336:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788460483.764717:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:10595:x1875336462654336:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 234us (444us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788460483.764725:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:1.0:1788460483.767817:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.767915:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462654592 00000100:00100000:2.0:1788460483.767926:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462654592 00000100:00100000:2.0:1788460483.767988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:2.0:1788460483.767997:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:10595:x1875336462654592:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788460483.768123:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:10595:x1875336462654592:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460483.768131:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:3.0:1788460483.773016:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.773172:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462654720 00000100:00100000:0.0:1788460483.773236:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462654720 00000100:00100000:0.0:1788460483.773297:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1788460483.773307:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:10595:x1875336462654720:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460483.773329:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460483.773347:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1438 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.773436:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.773451:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.773474:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460483.773509:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460483.773528:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.773554:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1438 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.773573:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1438 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.773582:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460483.773585:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788460483.773589:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b200, rc 0) 00000100:00100000:0.0:1788460483.773706:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:10595:x1875336462654720:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 400us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460483.773714:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:1.0:1788460483.782818:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460483.782919:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462654848 00000100:00100000:3.0:1788460483.782929:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462654848 00000100:00100000:3.0:1788460483.782996:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1788460483.783017:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462654848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460483.783036:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460483.783066:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d143f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460483.783092:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bdc2, blocks: 0x1 00010000:00010000:3.0:1788460483.783109:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788460483.783114:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460483.783123:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.783161:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.783173:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460483.783277:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462654848:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 271us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460483.783284:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:1.0:1788460483.787781:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.787872:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462655104 00000100:00100000:2.0:1788460483.787883:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462655104 00000100:00100000:2.0:1788460483.787943:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:2.0:1788460483.787953:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:10595:x1875336462655104:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788460483.788281:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:10595:x1875336462655104:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 327us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460483.788290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:1.0:1788460483.791405:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.791480:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462655232 00000100:00100000:2.0:1788460483.791490:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462655232 00000100:00100000:2.0:1788460483.791545:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:2.0:1788460483.791554:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:10595:x1875336462655232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460483.791573:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460483.791590:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1446 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.791653:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.791662:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460483.791666:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460483.791672:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.791707:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.791733:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 9 pid: 6700 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460483.791747:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875336482590976:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460483.791850:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d8388180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460483.795149:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.795292:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875336482590976:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460483.795327:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.795349:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460483.795413:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:10595:x1875336462655232:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 3858us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460483.795422:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:3.0:1788460483.795982:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462655360 00000100:00100000:3.0:1788460483.795989:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462655360 00010000:00010000:3.0:1788460483.796024:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 9 pid: 6700 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460483.796068:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:3.0:1788460483.796077:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2379:x1875336462655360:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460483.796091:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460483.796111:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 9 pid: 6700 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.796124:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 9 pid: 6700 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.796146:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b7a68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d143f expref: 9 pid: 6700 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.796225:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460483.796230:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460483.796239:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.796249:0:7669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.796284:0:7669:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460483.796298:0:7669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7669:1875336482591104:192.168.203.32@tcp:105: 00000100:00100000:3.0:1788460483.796357:0:7669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460483.799672:0:7669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7669:1875336482591104:192.168.203.32@tcp:105: 00010000:00010000:3.0:1788460483.799701:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460483.799760:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462655360:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 3683us (4619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460483.799770:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:1.0:1788460483.803500:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460483.803572:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462655488 00000100:00100000:3.0:1788460483.803581:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462655488 00002000:00100000:3.0:1788460483.803640:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9650efd28000 x1875336462655488/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:639/0 lens 504/0 e 0 to 0 dl 1788460494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460483.803650:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efd28000 with x1875336462655488 ext(0->12) 00002000:00010000:3.0:1788460483.803657:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650efd28000 00000100:00100000:3.0:1788460483.803704:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1788460483.803716:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462655488:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788460483.804164:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2379:x1875336462655488:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 447us (671us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788460483.804173:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00002000:00100000:3.0:1788460483.804217:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9650efd28000 x1875336462655488/t4294967309(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:639/0 lens 504/448 e 0 to 0 dl 1788460494 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460483.804225:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efd28000 with x1875336462655488 ext(0->12) 00002000:00010000:3.0:1788460483.804229:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650efd28000 00000100:00100000:1.0:1788460483.807149:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.807294:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462655616 00000100:00100000:0.0:1788460483.807304:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462655616 00000100:00100000:0.0:1788460483.807355:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:0.0:1788460483.807364:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:10595:x1875336462655616:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788460483.877531:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1788460483.877544:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788460483.877566:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788460483.877584:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650d14c9780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788460483.877589:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e89b6b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650d14c9240 00000020:00080000:2.0:1788460483.877592:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e89b6400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9650fca3b400 00000004:00080000:2.0:1788460483.877618:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788460483.877634:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650d14c9480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788460483.877637:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e8865c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650d14c9240 00000020:00080000:2.0:1788460483.877640:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e8865e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff965102057800 00000001:00080000:2.0:1788460483.877690:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1788460483.877731:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788460483.877744:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788460483.877946:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788460483.878012:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482591232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788460483.878088:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460483.878165:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482591232 00000100:00100000:2.0:1788460483.878465:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482591232 00000100:00100000:2.0:1788460483.878515:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788460483.878525:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482591232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788460483.878553:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788460483.878588:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a99bdc1, atime: 0x6a99bdc1, ctime: 0x6a99bdc1, blocks: 0x1 00010000:00010000:2.0:1788460483.878596:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.878615:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1788460483.878619:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460483.878626:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.878644:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.878656:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.878663:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.878688:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788460483.879460:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482591232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 933us (1368us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788460483.879469:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1788460483.879520:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650fcdc0a80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788460483.879525:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482591232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788460483.880944:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482591488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788460483.881013:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460483.881079:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460483.881085:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482591360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788460483.881108:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460483.881478:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460483.881487:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.881500:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460483.881505:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.881516:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.881535:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.881542:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026651593/0x889bb893541b7a76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.881565:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460483.881566:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460483.881581:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460483.881676:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:10595:x1875336462655616:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 74311us (74534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460483.881686:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:2.0:1788460483.881766:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482591488 00000100:00100000:2.0:1788460483.881773:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482591488 00000100:00100000:2.0:1788460483.881808:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482591360 00000100:00100000:2.0:1788460483.881811:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482591360 00000100:00100000:2.0:1788460483.881829:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788460483.881837:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482591488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788460483.881994:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788460483.881998:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788460482 00002000:00010000:2.0:1788460483.882000:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788460483.882002:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788460482 -> 1788460482 00002000:00010000:2.0:1788460483.882005:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788460483.882046:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482591488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (1034us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788460483.882221:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460483.882231:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482591360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788460483.882246:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1788460483.882369:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.882387:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.882395:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788460483.882399:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460483.882404:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.882430:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.882444:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 9 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460483.882457:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482591616:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460483.882498:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c12540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460483.882566:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:3.0:1788460483.882754:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650f5872680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788460483.882761:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482591488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788460483.885162:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.885502:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462655744 00000100:00100000:0.0:1788460483.885513:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462655744 00000100:00100000:0.0:1788460483.885572:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:0.0:1788460483.885581:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2379:x1875336462655744:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788460483.886133:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460483.886206:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462655872 00000100:00100000:3.0:1788460483.886210:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462655872 00010000:00010000:3.0:1788460483.886244:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 11 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460483.886399:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:3.0:1788460483.886407:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:2380:x1875336462655872:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460483.886428:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460483.886435:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 11 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.886448:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 11 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.886470:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460483.886475:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460483.886481:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.886490:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.886511:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460483.886562:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:2380:x1875336462655872:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 155us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460483.886576:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00010000:00010000:1.0:1788460483.886794:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008650ee5a/0x889bb893541b7838 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d13a5 expref: 10 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460483.886816:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482591616:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460483.886837:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.886928:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.886937:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.886947:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.886955:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.886977:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460483.887108:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460483.887116:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.887124:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460483.887138:0:7659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.887148:0:7659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.887161:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.887168:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000745dbad9/0x889bb893541b7a7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.887215:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460483.887217:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460483.887219:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460483.888085:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482591360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5852us (6970us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788460483.888096:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:1.0:1788460483.888146:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650f5870700/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788460483.888153:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482591360:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788460483.913767:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788460483.913785:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1788460483.913792:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788460483.914217:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462655744:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 28632us (29059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460483.914228:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:1.0:1788460483.916738:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.916833:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462656128 00000100:00100000:0.0:1788460483.916844:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462656128 00000100:00100000:0.0:1788460483.916907:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:0.0:1788460483.916921:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:10595:x1875336462656128:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788460483.916974:0:7007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460483.917005:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1438 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.917023:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460483.917028:0:7007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460483.917165:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.917282:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.917292:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460483.917872:0:7007:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030499094 reply state 000000001ef2aeca transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.917884:0:7007:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460483.918334:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:10595:x1875336462656128:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 1413us (1599us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788460483.918343:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 125 00010000:00010000:1.0:1788460483.921340:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.921357:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460483.921364:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1788460483.921365:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.921370:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5bc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460483.921375:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.921383:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.921398:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:1.0:1788460483.921401:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460483.921406:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.921412:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7a84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.921431:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462656256 00000100:00100000:0.0:1788460483.921440:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462656256 00000100:00100000:0.0:1788460483.921495:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:0.0:1788460483.921512:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462656256:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788460483.921713:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788460483.921717:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788460482 -> 1788460481 00002000:00010000:0.0:1788460483.921720:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788460481 00002000:00010000:0.0:1788460483.921723:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788460482 -> 1788460481 00002000:00010000:0.0:1788460483.921725:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788460483.921781:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462656256:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 270us (420us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788460483.921789:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:0.0:1788460483.924120:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460483.924376:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462656512 00000100:00100000:3.0:1788460483.924386:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462656512 00000100:00100000:3.0:1788460483.924490:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:3.0:1788460483.924504:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:10595:x1875336462656512:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788460483.924592:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.924620:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 15 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.924630:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.924664:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 15 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.924678:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 15 pid: 7007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460483.924691:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5871880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482591744:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460483.925695:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460483.928465:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5871880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482591744:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460483.928494:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.929554:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460483.929814:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462656640 00000100:00100000:3.0:1788460483.929824:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462656640 00010000:00010000:3.0:1788460483.929874:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 16 pid: 7007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460483.930144:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1788460483.930165:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:2380:x1875336462656640:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460483.930225:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460483.930233:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 16 pid: 7007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.930246:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 16 pid: 7007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.930277:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7a45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d142a expref: 16 pid: 7007 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.930293:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460483.930297:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.930306:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.930313:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.930345:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460483.930403:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:2380:x1875336462656640:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 240us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460483.930411:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00010000:00010000:0.0:1788460483.930470:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930479:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930507:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930514:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930520:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930526:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.930530:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930548:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930558:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460483.930560:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788460483.930564:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.930570:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7a8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.930628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:10595:x1875336462656512:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 6125us (6515us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788460483.930637:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:3.0:1788460483.941244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460483.941521:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462656768 00000100:00100000:1.0:1788460483.941531:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462656768 00000100:00100000:1.0:1788460483.941587:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1788460483.941606:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f60aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2382:x1875336462656768:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788460483.941651:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.941670:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.941690:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460483.941694:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460483.941699:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.941737:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.941752:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 7 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460483.941767:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482591872:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460483.941855:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c12540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460483.949059:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.949210:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462656896 00000100:00100000:0.0:1788460483.949220:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462656896 00010000:00010000:0.0:1788460483.949269:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 8 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.949314:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:0.0:1788460483.949325:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2380:x1875336462656896:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460483.949340:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460483.949363:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 8 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.949376:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 8 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.949421:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460483.949426:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460483.949434:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.949444:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.949468:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460483.949528:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2380:x1875336462656896:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 204us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460483.949538:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00010000:00010000:1.0:1788460483.953479:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60ea289/0x889bb893541b7a6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1446 expref: 7 pid: 6699 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460483.953506:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482591872:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460483.953536:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953548:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953555:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953671:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953681:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953689:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953696:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460483.953701:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953710:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953732:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.953740:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b86439/0x889bb893541b7a92 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460483.954117:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f60aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2382:x1875336462656768:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 12456us (12818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460483.954128:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:2.0:1788460483.962140:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460483.962373:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462657152 00000100:00100000:3.0:1788460483.962384:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462657152 00000100:00100000:3.0:1788460483.962454:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 127 00000100:00100000:3.0:1788460483.962465:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:10595:x1875336462657152:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788460483.962558:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.962574:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.962587:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.962791:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.962804:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.962812:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.965075:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.965099:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 15 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460483.965116:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5871880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482592000:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460483.965301:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460483.969674:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5871880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482592000:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460483.969705:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460483.971262:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460483.971394:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462657280 00000100:00100000:1.0:1788460483.971403:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462657280 00010000:00010000:1.0:1788460483.971441:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460483.971480:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:1.0:1788460483.971489:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+16:2379:x1875336462657280:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460483.971503:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460483.971510:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.971524:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.971546:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1431 expref: 16 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.971562:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:1.0:1788460483.971567:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.971576:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.971584:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460483.971617:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460483.971672:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:2379:x1875336462657280:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 184us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460483.971696:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00010000:00010000:0.0:1788460483.971872:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.971880:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460483.972058:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788460483.972262:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788460483.972312:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788460483.972390:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482592128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788460483.972438:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460483.972475:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f611bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460483.973042:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482592128 00000100:00100000:1.0:1788460483.973049:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482592128 00000100:00100000:1.0:1788460483.973093:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460483.973101:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875336482592128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788460483.973172:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875336482592128:12345-0@lo:1000:mdt00_001.0 Request processed in 71us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460483.973202:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460483.973563:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788460483.973569:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650f5872680, transno 4294967310 00000100:00100000:0.0:1788460483.973588:0:5843:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9650f5870700 x1875336482591360/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788460499 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460483.973608:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482592128:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788460483.974082:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788460483.974149:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482592256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788460483.974226:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460483.974258:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e8b22900 going to sleep for 11 seconds 00000100:00100000:1.0:1788460483.975283:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482592256 00000100:00100000:1.0:1788460483.975293:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482592256 00000100:00100000:1.0:1788460483.975340:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460483.975354:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875336482592256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788460483.975551:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1875336482592256:12345-0@lo:1000:mdt00_001.0 Request processed in 198us (1324us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788460483.975558:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460483.975795:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482592256:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788460483.975835:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975846:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975853:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975859:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460483.975864:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975872:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975887:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460483.975890:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460483.975894:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975901:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7aa0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975930:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975937:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975954:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975960:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460483.975963:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975969:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975977:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460483.975980:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460483.975987:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.975998:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.976006:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.976168:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460483.976219:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482592384:192.168.203.32@tcp:105: 00000100:00100000:2.0:1788460483.976291:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4567c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460483.979222:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482592384:192.168.203.32@tcp:105: 00010000:00010000:0.0:1788460483.979254:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979265:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b79e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979297:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979311:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979322:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979332:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979338:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979356:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979361:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.979364:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979370:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979381:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460483.979384:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460483.979387:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979392:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7aa7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979404:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979409:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979415:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979420:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029dc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460483.979423:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979439:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979447:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460483.979450:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460483.979453:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460483.979458:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029dc00/0x889bb893541b7a99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460483.979725:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:10595:x1875336462657152:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 17261us (17593us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788460483.979735:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 127 00000020:00080000:0.0:1788460483.979741:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788460483.979924:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788460483.979929:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788460483.980450:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788460483.980460:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788460483.981360:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460483.984059:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460483.984138:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462657408 00000100:00100000:3.0:1788460483.984149:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462657408 00000100:00100000:3.0:1788460483.984231:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1788460483.984241:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:10594:x1875336462657408:12345-192.168.203.32@tcp:49:lfs.0 00000100:00100000:3.0:1788460483.984369:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:10594:x1875336462657408:12345-192.168.203.32@tcp:49:lfs.0 Request processed in 128us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460483.984376:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1788460483.986667:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460483.987628:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462657664 00000100:00100000:2.0:1788460483.987640:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462657664 00000100:00100000:2.0:1788460483.987704:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:2.0:1788460483.987715:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d286a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:10595:x1875336462657664:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788460483.988295:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460483.988519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462657920 00000100:00100000:0.0:1788460483.988524:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462657920 00000100:00100000:0.0:1788460483.988556:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:0.0:1788460483.988563:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:10594:x1875336462657920:12345-192.168.203.32@tcp:58:lfs.0 00000004:00080000:2.0:1788460483.988761:0:12105:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788460483.988774:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788460483.988856:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:10594:x1875336462657920:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 291us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460483.988864:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000001:00080000:2.0:1788460483.989071:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788460483.989120:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.989137:0:12105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.989890:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.989903:0:12105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.989908:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.989914:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460483.989938:0:12105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460483.989994:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460483.990001:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.990024:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460483.990028:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.990036:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.990049:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460483.990061:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788460483.990066:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.990071:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7aae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460483.990088:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460483.990090:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460483.990091:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460483.990242:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d286a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:10595:x1875336462657664:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 2433us (3485us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788460483.990253:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000020:00080000:2.0:1788460483.990257:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788460484.011459:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460484.011551:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462658048 00000100:00100000:1.0:1788460484.011560:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462658048 00000100:00100000:1.0:1788460484.011615:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 129 00000100:00100000:1.0:1788460484.011625:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:10597:x1875336462658048:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460484.011651:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460484.011670:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7ab5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d144d expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.011751:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.011765:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.011776:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.011791:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.011798:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.011804:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.012065:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.012077:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.012084:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.012118:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.012142:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 21 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460484.012161:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482592512:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460484.012388:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c12540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460484.016775:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460484.016892:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482592512:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460484.016924:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460484.017005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462658304 00000100:00100000:0.0:1788460484.017012:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462658304 00000100:00100000:0.0:1788460484.017450:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:0.0:1788460484.017462:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:5618:x1875336462658304:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788460484.017733:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:5618:x1875336462658304:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 272us (966us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788460484.017742:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1788460484.021234:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460484.021431:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462658432 00000100:00100000:0.0:1788460484.021440:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462658432 00010000:00010000:0.0:1788460484.021478:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 23 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460484.021521:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:0.0:1788460484.021532:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:2380:x1875336462658432:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460484.021546:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460484.021553:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 23 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460484.021566:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 23 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460484.021589:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b79d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d140e expref: 23 pid: 5843 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460484.021606:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460484.021611:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460484.021621:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460484.021628:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460484.021679:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460484.021792:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:2380:x1875336462658432:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 261us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460484.021801:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00010000:00010000:1.0:1788460484.021869:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.021878:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460484.021920:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788460484.021925:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460484.021942:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.021955:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.021964:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.021971:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.021978:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.021984:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460484.021996:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022003:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022012:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:1.0:1788460484.022016:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460484.022019:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022026:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022037:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022042:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022048:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022053:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460484.022056:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022062:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022068:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9650c34d0e00) 00010000:00010000:1.0:1788460484.022071:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460484.022080:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022085:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022122:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7ab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d144d expref: 22 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022136:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d144d expref: 21 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460484.022143:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:1.0:1788460484.022156:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460484.022159:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4a00, rc 0) 00000100:00100000:1.0:1788460484.022249:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10597:x1875336462658048:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 10625us (10798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460484.022257:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 129 00000040:00080000:3.0:1788460484.806554:0:12144:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460484.806563:0:12144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460484.806608:0:12144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788460484.806616:0:12144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460484.846440:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460484.846488:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460484.846515:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460484.846535:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460484.846558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460484.846585:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462658816 00000100:00100000:3.0:1788460484.846594:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462658816 00000100:00100000:0.0:1788460484.847900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462658560 00000100:00100000:0.0:1788460484.847911:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462658560 00000100:00100000:0.0:1788460484.847957:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 314 00000100:00100000:0.0:1788460484.847966:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462658560:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460484.848052:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462658560:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 87us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460484.848060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 314 00000100:00100000:3.0:1788460484.848387:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462658944 00000100:00100000:3.0:1788460484.848392:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462658944 00000100:00100000:3.0:1788460484.848432:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1788460484.848439:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462658816:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460484.848469:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462658816:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 32us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460484.848475:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1788460484.848487:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1788460484.848492:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462658944:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460484.848513:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462658944:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 20us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460484.848518:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1788460484.848537:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462659072 00000100:00100000:3.0:1788460484.848540:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462659072 00000100:00100000:3.0:1788460484.848566:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462658688 00000100:00100000:3.0:1788460484.848569:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462658688 00000100:00100000:3.0:1788460484.848586:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:3.0:1788460484.848591:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462659072:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460484.848621:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462659072:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 30us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460484.848626:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:3.0:1788460484.848637:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:3.0:1788460484.848642:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:2379:x1875336462658688:12345-192.168.203.32@tcp:400:kworker.0 00000100:00080000:0.0:1788460484.849263:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460484.849271:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460484.851596:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:2379:x1875336462658688:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 2942us (5048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460484.851626:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 132 00000040:00080000:3.0:1788460485.005602:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460485.005611:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460485.005666:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788460485.005674:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460485.005792:0:11722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482592640:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460485.005882:0:11722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeba80 going to sleep for 11 seconds 00010000:00010000:1.0:1788460485.006022:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460485.007846:0:11722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482592640:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460485.011301:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460485.011407:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462659200 00000100:00100000:3.0:1788460485.011469:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462659200 00000100:00100000:3.0:1788460485.011548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00080000:0.0:1788460485.011552:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460485.011560:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10609:x1875336462659200:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460485.011592:0:5844:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460485.011704:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10609:x1875336462659200:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 146us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460485.011712:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:2.0:1788460485.015860:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460485.016175:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462659456 00000100:00100000:3.0:1788460485.016215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462659456 00000100:00100000:3.0:1788460485.016276:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:3.0:1788460485.016286:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:10609:x1875336462659456:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460485.016307:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460485.016327:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ad1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1454 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.016430:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ad8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.016456:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.016468:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460485.016481:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788460485.016877:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ad1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1454 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.016899:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1454 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.016907:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:3.0:1788460485.016910:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460485.016914:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029de00, rc 0) 00000100:00100000:3.0:1788460485.017024:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:10609:x1875336462659456:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 738us (1173us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788460485.017032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 131 00000100:00100000:1.0:1788460485.028265:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460485.028304:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460485.028449:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462659840 00000100:00100000:3.0:1788460485.028460:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462659840 00000100:00100000:3.0:1788460485.028517:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:3.0:1788460485.028527:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:10609:x1875336462659840:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788460485.028608:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028625:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028649:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028828:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028835:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028841:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028846:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460485.028850:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028858:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028869:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:3.0:1788460485.028872:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460485.028876:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460485.028883:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7ae6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460485.029019:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:10609:x1875336462659840:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 492us (762us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788460485.029026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 132 00000100:00100000:2.0:1788460485.029688:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462659584 00000100:00100000:2.0:1788460485.029696:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462659584 00000100:00100000:2.0:1788460485.029742:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460485.029749:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:2381:x1875336462659584:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460485.029761:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460485.029777:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ad8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1454 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460485.029791:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460485.029794:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460485.029828:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:2381:x1875336462659584:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 79us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460485.029834:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000040:00080000:3.0:1788460485.030145:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460485.030150:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460485.031759:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788460485.031776:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460485.032155:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460485.037606:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462660096 00000100:00100000:2.0:1788460485.037620:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462660096 00000100:00100000:2.0:1788460485.037730:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1788460485.037740:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:10609:x1875336462660096:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788460485.037988:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:10609:x1875336462660096:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 248us (5835us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788460485.037997:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00010000:00010000:1.0:1788460486.028564:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460486.763358:0:12195:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460486.763368:0:12195:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460486.763410:0:12195:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788460486.763415:0:12195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788460486.951337:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460486.951383:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462660352 00000100:00100000:2.0:1788460486.951391:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462660352 00000100:00100000:2.0:1788460486.951438:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:2.0:1788460486.951448:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:10630:x1875336462660352:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460486.951472:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460486.951490:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7aed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d145b expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460486.951584:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7af4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460486.951597:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460486.951609:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460486.951618:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788460486.951734:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7aed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d145b expref: 27 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460486.951750:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d145b expref: 26 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460486.951758:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460486.951761:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788460486.951765:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009a00, rc 0) 00000100:00100000:2.0:1788460486.951818:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:10630:x1875336462660352:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 372us (489us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788460486.951835:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 133 00000100:00100000:0.0:1788460486.960502:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460486.960544:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462660480 00000100:00100000:0.0:1788460486.960554:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462660480 00000100:00100000:0.0:1788460486.960618:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 134 00000100:00100000:0.0:1788460486.960629:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:10630:x1875336462660480:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1788460486.960693:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960722:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960734:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960758:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960765:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960771:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960777:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460486.960781:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960788:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960799:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:0.0:1788460486.960803:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460486.960807:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460486.960814:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460486.960882:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:10630:x1875336462660480:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 254us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460486.960895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 134 00010000:00010000:3.0:1788460487.054951:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460487.074213:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460487.074303:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462660608 00000100:00100000:3.0:1788460487.074313:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462660608 00000100:00100000:3.0:1788460487.074384:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:3.0:1788460487.074397:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462660608:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1788460487.074416:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460487.074438:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfe0ea1a/0x889bb893541b7b09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1462 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460487.074465:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a99bdc1, atime: 0x6a99bdc1, ctime: 0x6a99bdc1, blocks: 0xb 00010000:00010000:3.0:1788460487.074484:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788460487.074489:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460487.074498:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfe0ea1a/0x889bb893541b7b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1462 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460487.074517:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfe0ea1a/0x889bb893541b7b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1462 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460487.074530:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029dc00, rc 0) 00000100:00100000:3.0:1788460487.074597:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462660608:12345-192.168.203.32@tcp:101:cat.0 Request processed in 203us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460487.074604:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00080000:0.0:1788460487.074718:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460487.080533:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460487.080680:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462660736 00000100:00100000:2.0:1788460487.080690:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462660736 00002000:00100000:2.0:1788460487.080741:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9650efdd1500 x1875336462660736/t0(0) o3->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:643/0 lens 488/0 e 0 to 0 dl 1788460498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460487.080751:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efdd1500 with x1875336462660736 ext(0->4095) 00002000:00010000:2.0:1788460487.080757:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650efdd1500 00000100:00100000:3.0:1788460487.080823:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1788460487.080848:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462660736:12345-192.168.203.32@tcp:3:cat.0 00000100:00100000:3.0:1788460487.081083:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462660736:12345-192.168.203.32@tcp:3:cat.0 Request processed in 236us (559us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788460487.081090:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00002000:00100000:3.0:1788460487.081097:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9650efdd1500 x1875336462660736/t0(0) o3->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:643/0 lens 488/4536 e 0 to 0 dl 1788460498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460487.081105:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efdd1500 with x1875336462660736 ext(0->4095) 00002000:00010000:3.0:1788460487.081108:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650efdd1500 00000100:00100000:2.0:1788460487.180635:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460487.180658:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482592768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460487.180730:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460487.181139:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482592768 00000100:00100000:3.0:1788460487.181147:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482592768 00000100:00100000:3.0:1788460487.181234:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788460487.181243:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482592768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460487.181278:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460487.181321:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482592768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460487.181327:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788460487.181351:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482593024:0@lo:400:kworker.0 00000100:00100000:3.0:1788460487.181381:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460487.181405:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460487.181411:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482593152:0@lo:400:kworker.0 00000100:00100000:3.0:1788460487.181431:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788460487.181455:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460487.181467:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593024 00000100:00100000:3.0:1788460487.181470:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593024 00000100:00100000:3.0:1788460487.181496:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593152 00000100:00100000:3.0:1788460487.181499:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593152 00000100:00100000:3.0:1788460487.181540:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788460487.181546:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482593024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460487.181600:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482593024:12345-0@lo:400:kworker.0 Request processed in 54us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460487.181607:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788460487.181622:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788460487.181629:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482593152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460487.181656:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482593152:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460487.181661:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1788460487.181680:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460487.181707:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482593152:0@lo:400:kworker.0 00000100:00100000:3.0:1788460487.181717:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482593024:0@lo:400:kworker.0 00000100:00100000:0.0:1788460487.182036:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482592896:0@lo:400:kworker.0 00000100:00100000:0.0:1788460487.182075:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460487.182114:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482593408:0@lo:400:kworker.0 00000100:00100000:0.0:1788460487.182139:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460487.182203:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482592768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460487.182218:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460487.182223:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482593280:0@lo:400:kworker.0 00000100:00100000:0.0:1788460487.182248:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460487.182276:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593280 00000100:00100000:0.0:1788460487.182280:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593280 00000100:00100000:0.0:1788460487.182314:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788460487.182321:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482593280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460487.182356:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482593280:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460487.182362:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788460487.182391:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482593280:0@lo:400:kworker.0 00000100:00100000:1.0:1788460487.182515:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460487.182525:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482593536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460487.182552:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460487.182801:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593536 00000100:00100000:2.0:1788460487.182806:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593536 00000100:00100000:2.0:1788460487.182829:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788460487.182837:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482593536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460487.182873:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460487.182916:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482593536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460487.182922:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788460487.183082:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482593536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460487.183561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482592896 00000100:00100000:3.0:1788460487.183567:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482592896 00000100:00100000:3.0:1788460487.183720:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788460487.183728:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482592896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460487.183778:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482592896:12345-0@lo:400:kworker.0 Request processed in 51us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460487.183785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788460487.183966:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482592896:0@lo:400:kworker.0 00000100:00080000:1.0:1788460487.184011:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460487.184023:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593408 00000100:00100000:1.0:1788460487.184027:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593408 00000100:00100000:1.0:1788460487.184066:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788460487.184073:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482593408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460487.184111:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482593408:12345-0@lo:400:kworker.0 Request processed in 38us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460487.184117:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788460487.184131:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460487.184148:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482593408:0@lo:400:kworker.0 00000001:00080000:3.0:1788460487.272798:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788460487.272816:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1788460488.076343:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460489.101086:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788460489.284824:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788460489.285491:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788460489.286451:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:2.0:1788460489.286467:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650f611bd80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788460489.286472:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650fdf3eb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650f611b9c0 00000020:00080000:2.0:1788460489.286476:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650fdf3ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9650f5dd5c00 00000001:00080000:2.0:1788460489.286495:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788460489.286509:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788460489.286531:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788460489.286801:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788460489.962689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460489.962728:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460489.962762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460489.962786:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460489.962811:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460489.962839:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462660864 00000100:00100000:2.0:1788460489.962849:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462660864 00000100:00100000:2.0:1788460489.962895:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 316 00000100:00100000:2.0:1788460489.962905:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462660864:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460489.962974:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462660864:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460489.962982:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 316 00000100:00100000:2.0:1788460489.963015:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462661248 00000100:00100000:2.0:1788460489.963019:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462661248 00000100:00100000:2.0:1788460489.963062:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462661120 00000100:00100000:2.0:1788460489.963065:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462661120 00000100:00100000:2.0:1788460489.963089:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460489.963097:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462661248:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460489.963127:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462661248:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460489.963145:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460489.963157:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1788460489.963165:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462661120:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460489.963217:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462661120:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 53us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460489.963237:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00080000:2.0:1788460489.963924:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460489.963929:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460489.964112:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462660992 00000100:00100000:3.0:1788460489.964121:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462660992 00000100:00100000:3.0:1788460489.964207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462661376 00000100:00100000:3.0:1788460489.964224:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462661376 00000100:00100000:3.0:1788460489.964256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:3.0:1788460489.964265:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2381:x1875336462660992:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460489.964321:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2381:x1875336462660992:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 57us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460489.964328:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:3.0:1788460489.964341:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:3.0:1788460489.964348:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462661376:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460489.964370:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462661376:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460489.964376:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00080000:2.0:1788460489.964476:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788460490.124317:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460491.153078:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460491.897934:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460491.898043:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462661504 00000100:00100000:0.0:1788460491.898054:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462661504 00000100:00100000:0.0:1788460491.898132:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00100000:0.0:1788460491.898143:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:10275:x1875336462661504:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788460491.898282:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:10275:x1875336462661504:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 Request processed in 140us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460491.898315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 135 00000100:00080000:2.0:1788460491.898769:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460491.901456:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460491.902241:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462661760 00000100:00100000:3.0:1788460491.902251:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462661760 00000100:00100000:3.0:1788460491.902307:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1788460491.902316:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:10275:x1875336462661760:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788460491.902639:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:10275:x1875336462661760:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 322us (1191us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788460491.902647:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:1.0:1788460492.123373:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460492.123459:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462661888 00000100:00100000:3.0:1788460492.123469:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462661888 00000100:00100000:3.0:1788460492.123556:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 136 00000100:00100000:3.0:1788460492.123567:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:11084:x1875336462661888:12345-192.168.203.32@tcp:101:lsof.0 00010000:00010000:3.0:1788460492.123588:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460492.123608:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7b10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1469 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788460492.123872:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460492.123953:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460492.123969:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460492.123983:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460492.124028:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460492.124032:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460492.124073:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460492.124096:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7b10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 7 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460492.124113:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 6 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460492.124133:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:3.0:1788460492.124136:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460492.124140:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d200, rc 0) 00000100:00100000:3.0:1788460492.124429:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+6:11084:x1875336462661888:12345-192.168.203.32@tcp:101:lsof.0 Request processed in 863us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460492.124437:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 136 00010000:00010000:2.0:1788460492.172463:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460492.236917:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460492.236927:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460492.237271:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788460492.237278:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460492.300742:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482594048:0@lo:400:kworker.0 00000100:00100000:0.0:1788460492.300804:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460492.300863:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788460492.300869:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482593664:0@lo:400:kworker.0 00000100:00100000:0.0:1788460492.300893:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460492.300913:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482594176:0@lo:400:kworker.0 00000100:00100000:0.0:1788460492.300931:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460492.300956:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593664 00000100:00100000:0.0:1788460492.300962:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593664 00000100:00100000:0.0:1788460492.301014:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788460492.301024:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482593664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460492.301070:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482593664:12345-0@lo:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460492.301078:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788460492.301134:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482593664:0@lo:400:kworker.0 00000100:00100000:0.0:1788460492.301159:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594176 00000100:00100000:0.0:1788460492.301163:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594176 00000100:00100000:0.0:1788460492.301216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788460492.301223:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482594176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460492.301258:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482594176:12345-0@lo:400:kworker.0 Request processed in 35us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460492.301265:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788460492.301293:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482594176:0@lo:400:kworker.0 00000100:00100000:3.0:1788460492.301448:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594048 00000100:00100000:3.0:1788460492.301453:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594048 00000100:00100000:3.0:1788460492.301491:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460492.301498:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482594048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460492.301537:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482594048:12345-0@lo:400:kworker.0 Request processed in 40us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460492.301544:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788460492.301613:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788460492.301618:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788460492.301632:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650fcdc0a80, transno 4294967304 00000100:00100000:0.0:1788460492.301658:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482594048:0@lo:400:kworker.0 00000100:00100000:1.0:1788460492.302535:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482593792:0@lo:400:kworker.0 00000100:00100000:1.0:1788460492.302577:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460492.302606:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482594304:0@lo:400:kworker.0 00000100:00100000:1.0:1788460492.302629:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460492.302964:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788460492.302972:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482593920:0@lo:400:kworker.0 00000100:00100000:1.0:1788460492.303005:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460492.303029:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482594432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460492.303052:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460492.303091:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593792 00000100:00100000:1.0:1788460492.303097:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593792 00000100:00100000:1.0:1788460492.303140:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482593920 00000100:00100000:1.0:1788460492.303143:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482593920 00000100:00100000:1.0:1788460492.303199:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788460492.303207:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482593792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460492.303252:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482593792:12345-0@lo:400:kworker.0 Request processed in 46us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460492.303259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788460492.303275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788460492.303281:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482593920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460492.303306:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482593920:12345-0@lo:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460492.303311:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788460492.303325:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460492.303333:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482594560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460492.303357:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460492.303384:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594432 00000100:00100000:1.0:1788460492.303389:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594432 00000100:00100000:1.0:1788460492.303408:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594560 00000100:00100000:1.0:1788460492.303411:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594560 00000100:00100000:1.0:1788460492.303423:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788460492.303429:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482594432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460492.303456:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460492.303485:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482594432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460492.303491:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788460492.303503:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788460492.303508:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482594560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460492.303525:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460492.303562:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482594560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460492.303568:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788460492.303603:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482594560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460492.303630:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482593920:0@lo:400:kworker.0 00000100:00100000:1.0:1788460492.304513:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788460492.304520:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650f5870700, transno 4294967311 00000004:00080000:1.0:1788460492.304581:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788460492.304607:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482594432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460492.304623:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482593792:0@lo:400:kworker.0 00000100:00100000:2.0:1788460492.306242:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594304 00000100:00100000:2.0:1788460492.306263:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594304 00000100:00100000:2.0:1788460492.306323:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788460492.306332:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482594304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460492.306410:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482594304:12345-0@lo:400:kworker.0 Request processed in 79us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460492.306417:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788460492.306439:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460492.306443:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460492.306446:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460492.308132:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482594304:0@lo:400:kworker.0 00010000:00010000:3.0:1788460493.196739:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460494.220788:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788460494.418527:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1788460494.418564:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788460494.418613:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788460494.418623:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788460495.084305:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460495.084348:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460495.084379:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460495.084413:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460495.084453:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460495.084480:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462662400 00000100:00100000:0.0:1788460495.084489:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462662400 00000100:00100000:0.0:1788460495.084545:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462662272 00000100:00100000:0.0:1788460495.084548:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462662272 00000100:00100000:0.0:1788460495.084569:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1788460495.084577:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462662400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460495.084640:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462662400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 64us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460495.084649:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1788460495.084665:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:0.0:1788460495.084672:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462662272:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460495.084694:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462662272:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460495.084699:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00080000:0.0:1788460495.084715:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460495.084732:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460495.084927:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462662144 00000100:00100000:1.0:1788460495.084932:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462662144 00000100:00100000:1.0:1788460495.084981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462662528 00000100:00100000:1.0:1788460495.084984:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462662528 00000100:00100000:1.0:1788460495.085006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:1.0:1788460495.085012:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2379:x1875336462662144:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460495.085046:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2379:x1875336462662144:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 34us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460495.085052:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:1.0:1788460495.085065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:1.0:1788460495.085070:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+6:2379:x1875336462662528:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460495.085094:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+6:2379:x1875336462662528:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460495.085110:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00080000:0.0:1788460495.085598:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460495.085652:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462662016 00000100:00100000:2.0:1788460495.085658:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462662016 00000100:00100000:2.0:1788460495.085696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 318 00000100:00100000:2.0:1788460495.085703:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462662016:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460495.085758:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d3338450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462662016:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 55us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460495.085764:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 318 00010000:00010000:2.0:1788460495.244543:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460496.270848:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460496.305934:0:12398:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:34:53 (1788460493) 00010000:00010000:3.0:1788460497.292902:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460497.420464:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482594688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460497.420544:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460497.420901:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594688 00000100:00100000:1.0:1788460497.420909:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594688 00000100:00100000:1.0:1788460497.420957:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788460497.420964:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482594688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460497.420993:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460497.421036:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482594688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460497.421042:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788460497.421205:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460497.421316:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482594688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460497.425482:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788460497.425505:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482594816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460497.425570:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460497.425621:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594816 00000100:00100000:3.0:1788460497.425629:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594816 00000100:00100000:3.0:1788460497.425682:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788460497.425689:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482594816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460497.425723:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460497.425763:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482594816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460497.425770:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788460497.425791:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460497.425822:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482594816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460497.427489:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482595328:0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.427545:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460497.427579:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460497.427599:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482594944:0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.427629:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460497.427668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482595328 00000100:00100000:3.0:1788460497.427674:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482595328 00000100:00100000:3.0:1788460497.427725:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788460497.427734:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482595328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.427777:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482595328:12345-0@lo:400:kworker.0 Request processed in 45us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460497.427783:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788460497.427801:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482594944 00000100:00100000:3.0:1788460497.427805:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482594944 00000100:00100000:3.0:1788460497.427827:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788460497.427834:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482594944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.427861:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d333ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482594944:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460497.427867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788460497.427898:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482595072:0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.427921:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460497.427939:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460497.427944:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482595200:0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.427964:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460497.427986:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482595072 00000100:00100000:3.0:1788460497.427989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482595072 00000100:00100000:3.0:1788460497.428009:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482595200 00000100:00100000:3.0:1788460497.428012:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482595200 00000100:00100000:3.0:1788460497.428030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788460497.428035:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482595072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.428078:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482595072:12345-0@lo:400:kworker.0 Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460497.428094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788460497.428106:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788460497.428112:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482595200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.428138:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482595200:12345-0@lo:400:kworker.0 Request processed in 27us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460497.428144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788460497.428163:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460497.428212:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482595200:0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.428510:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482595072:0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.428552:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482594944:0@lo:400:kworker.0 00000100:00100000:3.0:1788460497.428563:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482595328:0@lo:400:kworker.0 00000100:00100000:0.0:1788460497.622678:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460497.624207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462662784 00000100:00100000:3.0:1788460497.624221:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462662784 00000100:00100000:3.0:1788460497.624485:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:3.0:1788460497.624499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:11349:x1875336462662784:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460497.624521:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460497.624541:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7b1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1470 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.624611:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.624625:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.624653:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.624667:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.624674:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.624679:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625129:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7b33 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625139:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7b33 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625145:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7b33 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460497.625155:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788460497.625457:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625465:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625472:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625478:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460497.625489:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625497:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625509:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650c34d0c00) 00010000:00010000:3.0:1788460497.625512:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460497.625517:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625523:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7b25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625536:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625541:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625547:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625553:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460497.625555:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625561:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625567:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9650c52ed600) 00010000:00010000:3.0:1788460497.625570:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460497.625577:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.625583:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7b2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788460497.625891:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460497.626881:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7b1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1470 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.626905:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7b33 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1470 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460497.626913:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:3.0:1788460497.626916:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460497.626919:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029cc00, rc 0) 00000100:00100000:3.0:1788460497.627001:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:11349:x1875336462662784:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2505us (4331us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788460497.627010:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 137 00000100:00100000:3.0:1788460497.638742:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460497.638791:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460497.638904:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462662912 00000100:00100000:0.0:1788460497.638914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462662912 00000100:00100000:0.0:1788460497.638982:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:0.0:1788460497.638993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:11349:x1875336462662912:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788460497.639128:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:11349:x1875336462662912:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 137us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460497.639144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 138 00000100:00100000:2.0:1788460497.640341:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462663040 00000100:00100000:2.0:1788460497.640350:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462663040 00000100:00100000:2.0:1788460497.640418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460497.640428:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:2381:x1875336462663040:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460497.640441:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460497.640466:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7b33 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1470 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460497.640487:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:2.0:1788460497.640491:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460497.640540:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:2381:x1875336462663040:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 113us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460497.640547:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:2.0:1788460498.316377:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460498.382092:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460498.382102:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460498.382137:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788460498.382143:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788460499.346472:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788460499.528075:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:2.0:1788460499.765899:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460499.766439:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462663168 00000100:00100000:1.0:1788460499.766450:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462663168 00000100:00100000:1.0:1788460499.766527:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00100000:1.0:1788460499.766537:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:11391:x1875336462663168:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460499.766556:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460499.766574:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7b41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1477 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766634:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766649:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766663:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766686:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766694:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766700:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766875:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766883:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766889:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766894:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460499.766899:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766906:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766918:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:1.0:1788460499.766921:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460499.766926:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766931:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766948:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766954:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766959:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766964:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460499.766967:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766972:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766980:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9650c34d0900) 00010000:00010000:1.0:1788460499.766983:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460499.766985:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.766991:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.767024:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7b41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1477 expref: 14 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.767033:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:1.0:1788460499.767036:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460499.767046:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7b41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1477 expref: 14 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.767057:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4000, rc 0) 00000100:00100000:1.0:1788460499.767125:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:11391:x1875336462663168:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 589us (1235us total) trans 0 rc 301/301 00000100:00100000:1.0:1788460499.767133:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 139 00000100:00080000:0.0:1788460499.767454:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460499.784567:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460499.785415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462663424 00000100:00100000:2.0:1788460499.785427:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462663424 00000100:00100000:2.0:1788460499.785504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 140 00000100:00100000:2.0:1788460499.785515:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:11391:x1875336462663424:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:2.0:1788460499.785570:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460499.785595:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b74bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12b0 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.785615:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:2.0:1788460499.785619:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460499.785809:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.785823:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 5 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.785831:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.785860:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 5 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.785872:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 5 pid: 7007 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460499.785885:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482595456:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460499.785967:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460499.801354:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482595456:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460499.801366:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:2.0:1788460499.801389:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460499.801407:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462663552 00000100:00100000:1.0:1788460499.801416:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462663552 00010000:00010000:1.0:1788460499.801479:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 6 pid: 7007 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788460499.801499:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460499.801513:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:1.0:1788460499.801523:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ece97008-0c90-48dc-9560-3b476895ed7b+6:2379:x1875336462663552:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460499.801535:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460499.801541:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 6 pid: 7007 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.801552:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 6 pid: 7007 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.801572:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7b17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1469 expref: 6 pid: 7007 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.801586:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:1.0:1788460499.801591:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.801611:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.801619:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460499.801649:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460499.801699:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ece97008-0c90-48dc-9560-3b476895ed7b+5:2379:x1875336462663552:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 176us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460499.801706:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00010000:00010000:2.0:1788460499.801831:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.801840:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.801863:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.801873:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.801881:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460499.802912:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788460499.802926:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.802936:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.802943:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.802949:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460499.802953:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.802960:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.802978:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650d2c3c700) 00010000:00010000:2.0:1788460499.802981:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460499.802985:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.802991:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b56 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460499.803007:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d096622b reply state 00000000088fdf1b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460499.803016:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460499.803111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:11391:x1875336462663424:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 17597us (18552us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788460499.803119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 140 00010000:00010000:0.0:1788460499.813586:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460499.813601:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460499.813609:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460499.813615:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460499.813620:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460499.813628:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460499.813643:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9650c3cb0600) 00010000:00010000:0.0:1788460499.813654:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460499.813660:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460499.813667:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7b5d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460499.933104:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460499.933307:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462663680 00000100:00100000:1.0:1788460499.933318:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462663680 00000100:00100000:1.0:1788460499.933378:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:1.0:1788460499.933388:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:11399:x1875336462663680:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:1.0:1788460499.933414:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460499.933436:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d147e expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.933839:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.933855:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.933866:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460499.933902:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460499.933906:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460499.933927:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.933951:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d147e expref: 15 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.933982:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d147e expref: 14 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460499.933991:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:2.0:1788460499.933995:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460499.933998:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008200, rc 0) 00000100:00100000:2.0:1788460499.934059:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:11399:x1875336462663680:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 671us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460499.934074:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:1.0:1788460500.011930:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460500.012026:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462663808 00000100:00100000:0.0:1788460500.012036:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462663808 00000100:00100000:0.0:1788460500.012102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:0.0:1788460500.012369:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:11405:x1875336462663808:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460500.012392:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460500.012411:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7b72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1485 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012471:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012484:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012507:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012526:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012533:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012540:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012646:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7b87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012654:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012661:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460500.012688:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788460500.012692:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460500.012708:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7b87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012719:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012726:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012732:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012738:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5bc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460500.012742:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012749:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012759:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:0.0:1788460500.012768:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460500.012774:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012781:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5bc00/0x889bb893541b7b79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012795:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012801:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012807:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012812:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460500.012815:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012822:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012829:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9650d2c3cc00) 00010000:00010000:0.0:1788460500.012832:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460500.012835:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012839:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7b80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012866:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7b72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1485 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012891:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7b87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1485 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.012898:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460500.012900:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788460500.012902:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a200, rc 0) 00000100:00100000:0.0:1788460500.013280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:11405:x1875336462663808:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1168us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460500.013288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:0.0:1788460500.024216:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.024305:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462664064 00000100:00100000:2.0:1788460500.024314:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462664064 00000100:00100000:2.0:1788460500.024379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 143 00000100:00100000:2.0:1788460500.024389:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+15:11405:x1875336462664064:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460500.024410:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.024430:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7b8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d148c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.024553:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.024568:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.024579:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.024591:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.024607:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.024613:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460500.025114:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788460500.025310:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025320:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025327:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025358:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025365:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025372:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025378:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460500.025382:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025389:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025412:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460500.025415:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460500.025420:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025427:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7b95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460500.025440:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045ea8a56 reply state 0000000081ac7999 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.025449:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788460500.025478:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7b8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025490:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.025497:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:2.0:1788460500.025499:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460500.025502:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009e00, rc 0) 00000100:00100000:2.0:1788460500.025560:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11405:x1875336462664064:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1173us (1387us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788460500.025568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 143 00010000:00010000:1.0:1788460500.027738:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.027756:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.027763:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.027769:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460500.027787:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.027796:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.027811:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c3cb0300) 00010000:00010000:1.0:1788460500.027814:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460500.027818:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.027824:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7b9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460500.030912:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.031740:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462664192 00000100:00100000:2.0:1788460500.031751:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462664192 00000100:00100000:2.0:1788460500.031833:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:2.0:1788460500.031843:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462664192:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460500.031874:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.031895:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1493 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460500.031920:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460500.031939:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1788460500.031962:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460500.031972:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.031989:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.032001:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460500.032074:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462664192:12345-192.168.203.32@tcp:101:bash.0 Request processed in 224us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.032080:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00080000:0.0:1788460500.034652:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460500.035431:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460500.035567:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462664320 00000100:00100000:1.0:1788460500.035578:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462664320 00000100:00100000:1.0:1788460500.035631:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1788460500.035642:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:11405:x1875336462664320:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460500.035661:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460500.035685:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d149a expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.035717:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.035726:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460500.035730:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460500.035736:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.035788:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.035801:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 7 pid: 6699 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460500.035815:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875336482595584:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460500.035916:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460500.044677:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1875336482595584:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460500.044711:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.044730:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4400, rc 0) 00000100:00100000:2.0:1788460500.044788:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:11405:x1875336462664320:12345-192.168.203.32@tcp:101:bash.0 Request processed in 9147us (9363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.044798:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:0.0:1788460500.050787:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.050913:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462664448 00000100:00100000:2.0:1788460500.050923:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462664448 00010000:00010000:2.0:1788460500.051091:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 7 pid: 6699 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.051135:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:2.0:1788460500.051145:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462664448:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460500.051159:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460500.051221:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 7 pid: 6699 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.051235:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 7 pid: 6699 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.051258:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d60ea289/0x889bb893541b7bb1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1493 expref: 7 pid: 6699 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.051274:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460500.051278:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460500.051286:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.051295:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.051330:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.051563:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875336482595712:192.168.203.32@tcp:105: 00000100:00100000:2.0:1788460500.051643:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460500.056113:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460500.058074:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462664704 00000100:00100000:1.0:1788460500.058091:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462664704 00000100:00100000:1.0:1788460500.058160:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1788460500.058170:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:11405:x1875336462664704:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:1.0:1788460500.058543:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11405:x1875336462664704:12345-192.168.203.32@tcp:35:bash.0 Request processed in 372us (2436us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788460500.058552:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:2.0:1788460500.060197:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875336482595712:192.168.203.32@tcp:105: 00010000:00010000:2.0:1788460500.060230:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460500.060967:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462664448:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 9820us (10185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.060977:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:0.0:1788460500.159283:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.159403:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462664960 00000100:00100000:2.0:1788460500.159413:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462664960 00000100:00100000:2.0:1788460500.159477:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 144 00000100:00100000:2.0:1788460500.159487:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11415:x1875336462664960:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460500.159516:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.159535:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14a1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460500.159618:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788460500.159733:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7bbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14a1 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.159746:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:2.0:1788460500.159749:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460500.159754:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14a1 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.159768:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460500.159853:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:11415:x1875336462664960:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 367us (579us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788460500.159859:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 144 00000100:00100000:3.0:1788460500.162153:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460500.162247:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462665216 00000100:00100000:0.0:1788460500.162256:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462665216 00000100:00100000:0.0:1788460500.162303:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:0.0:1788460500.162311:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:11415:x1875336462665216:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1788460500.162533:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:11415:x1875336462665216:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 222us (388us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788460500.162541:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:0.0:1788460500.203270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460500.203392:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460500.203533:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462665344 00000100:00100000:1.0:1788460500.203543:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462665344 00000100:00100000:1.0:1788460500.203597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 320 00000100:00100000:1.0:1788460500.203606:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462665344:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460500.203686:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462665344:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460500.203693:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 320 00000100:00100000:2.0:1788460500.204484:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462665472 00000100:00100000:2.0:1788460500.204549:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462665472 00000100:00100000:2.0:1788460500.204659:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:2.0:1788460500.204668:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462665472:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460500.204728:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462665472:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 61us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.204735:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00080000:0.0:1788460500.205394:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460500.258042:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.258154:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462665600 00000100:00100000:2.0:1788460500.258164:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462665600 00000100:00100000:2.0:1788460500.258240:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:2.0:1788460500.258250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:11421:x1875336462665600:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460500.258277:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.258296:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7bcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14a8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.258358:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7bd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.258371:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.258383:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460500.258415:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788460500.258433:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460500.258453:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.258478:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7bcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14a8 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.258494:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14a8 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.258503:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460500.258506:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460500.258509:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009c00, rc 0) 00000100:00100000:2.0:1788460500.258586:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:11421:x1875336462665600:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 334us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.258594:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:1.0:1788460500.265488:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.265594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462665856 00000100:00100000:2.0:1788460500.265604:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462665856 00000100:00100000:2.0:1788460500.265682:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:2.0:1788460500.265692:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:11421:x1875336462665856:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460500.265714:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.265733:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14af expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.265830:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.265844:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.265865:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460500.265877:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788460500.265998:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14af expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.266017:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14af expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.266025:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:2.0:1788460500.266028:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460500.266032:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008a00, rc 0) 00000100:00100000:2.0:1788460500.266101:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:11421:x1875336462665856:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 410us (621us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788460500.266108:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 146 00000100:00100000:0.0:1788460500.272408:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460500.272514:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.273678:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462666240 00000100:00100000:2.0:1788460500.273690:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462666240 00000100:00100000:2.0:1788460500.273760:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:2.0:1788460500.273771:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:11421:x1875336462666240:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460500.273796:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.273818:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7bf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14b6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.273913:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7bf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.273953:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.273965:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7bf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460500.273978:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788460500.274113:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7bf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14b6 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.274132:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7bf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14b6 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.274141:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:2.0:1788460500.274144:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788460500.274147:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009200, rc 0) 00000100:00100000:2.0:1788460500.274251:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+25:11421:x1875336462666240:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 481us (1736us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788460500.274258:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:1.0:1788460500.275049:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462665984 00000100:00100000:1.0:1788460500.275057:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462665984 00000100:00100000:1.0:1788460500.275118:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1788460500.275127:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+25:2382:x1875336462665984:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460500.275138:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460500.275154:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7be2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14af expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.275169:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:1.0:1788460500.275173:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460500.275298:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:2382:x1875336462665984:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 171us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460500.275305:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1788460500.281302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460500.284028:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462666368 00000100:00100000:3.0:1788460500.284041:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462666368 00000100:00100000:0.0:1788460500.286900:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:0.0:1788460500.286913:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462666368:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:0.0:1788460500.286969:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.286987:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.286995:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460500.286999:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460500.287004:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.287039:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.287054:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 6 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460500.287077:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1875336482595840:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460500.287202:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d831ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460500.289506:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.289708:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462666496 00000100:00100000:2.0:1788460500.289717:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462666496 00002000:00100000:2.0:1788460500.289763:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9650f5871f80 x1875336462666496/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:656/0 lens 504/0 e 0 to 0 dl 1788460511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460500.289774:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650f5871f80 with x1875336462666496 ext(0->12) 00010000:00010000:2.0:1788460500.289783:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 7 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.289817:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 7 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460500.289825:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650f5871f80 00000100:00100000:2.0:1788460500.289862:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1788460500.289871:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462666496:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:2.0:1788460500.290599:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5871f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2380:x1875336462666496:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 726us (1098us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788460500.290609:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00002000:00100000:2.0:1788460500.290617:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9650f5871f80 x1875336462666496/t4294967305(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:656/0 lens 504/448 e 0 to 0 dl 1788460511 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460500.290626:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650f5871f80 with x1875336462666496 ext(0->12) 00010000:00010000:2.0:1788460500.290639:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 9 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.290652:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 9 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460500.290659:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650f5871f80 00000100:00100000:0.0:1788460500.290830:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1875336482595840:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460500.290861:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460500.294380:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.294564:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462666624 00000100:00100000:2.0:1788460500.294573:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462666624 00010000:00010000:2.0:1788460500.294611:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 9 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.294678:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:2.0:1788460500.294688:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2381:x1875336462666624:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460500.294702:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788460500.294719:0:7669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788460500.294722:0:7669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788460499 00002000:00010000:2.0:1788460500.294725:0:7669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788460499 00002000:00010000:2.0:1788460500.294727:0:7669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788460499 00010000:00010000:2.0:1788460500.294733:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 9 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.294748:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 9 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.294769:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b7bb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d149a expref: 9 pid: 6701 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.294786:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460500.294791:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460500.294797:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.294807:0:7669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.294935:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460500.295002:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462666624:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 315us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.295011:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00010000:00010000:3.0:1788460500.299501:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.299546:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.300646:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.300668:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.300678:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.300686:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460500.300690:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.300698:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.300717:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.300725:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b7c05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.300829:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462666368:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 13914us (19532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.300852:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1788460500.315375:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460500.315565:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462666880 00000100:00100000:3.0:1788460500.315576:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462666880 00000100:00100000:3.0:1788460500.315632:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:3.0:1788460500.315641:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d286b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:11421:x1875336462666880:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:3.0:1788460500.315711:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7bf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14b6 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460500.316084:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788460500.316136:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788460500.316869:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788460500.317083:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.317102:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.317111:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.317151:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.317166:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 28 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.317205:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875336482595968:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460500.317589:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460500.325007:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460500.325315:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462667008 00000100:00100000:3.0:1788460500.325325:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462667008 00010000:00010000:3.0:1788460500.325364:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 29 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460500.325406:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1788460500.325416:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:2379:x1875336462667008:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460500.325432:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460500.325448:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 29 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.325462:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 29 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.325512:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:3.0:1788460500.325518:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.325528:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.325536:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.325556:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460500.325616:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:2379:x1875336462667008:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 200us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460500.325624:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00010000:00010000:2.0:1788460500.326888:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7ba3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d148c expref: 28 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.326911:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875336482595968:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460500.327412:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.327425:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.327455:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460500.327689:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788460500.327893:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788460500.328014:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482596096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788460500.328143:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460500.328403:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460500.328740:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482596096 00000100:00100000:1.0:1788460500.328748:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482596096 00000100:00100000:1.0:1788460500.328846:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460500.328855:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875336482596096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788460500.328931:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875336482596096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460500.328949:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460500.328988:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5d4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482596096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788460500.330403:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00080000:2.0:1788460500.330427:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460500.330620:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482596224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788460500.330684:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460500.330767:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460500.330814:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482596224 00000100:00100000:0.0:1788460500.330821:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482596224 00000100:00100000:0.0:1788460500.330865:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460500.330875:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875336482596224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460500.331045:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875336482596224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 171us (360us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788460500.331220:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875336482596224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788460500.331400:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788460500.331438:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.331567:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.331572:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.331577:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460500.331580:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.331586:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.331597:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:1.0:1788460500.331599:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788460500.331603:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.331607:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788460500.331767:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788460500.331900:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788460500.331911:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373567731044ns, next at 374567728798ns, rc = 0 00000001:00080000:1.0:1788460500.331926:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788460500.331957:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0000) 00010000:00010000:1.0:1788460500.331960:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788460500.331967:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7bf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14b6 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460500.332148:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460500.332555:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d286b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:11421:x1875336462666880:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 16913us (17186us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788460500.332564:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000020:00080000:1.0:1788460500.332567:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788460500.344081:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.344110:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462667136 00000100:00100000:2.0:1788460500.344120:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462667136 00000100:00100000:2.0:1788460500.344194:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 148 00000100:00100000:2.0:1788460500.344205:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:11421:x1875336462667136:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460500.344290:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.344311:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7c13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14bd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.344372:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14bd expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.344387:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7c13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14bd expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.344405:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460500.344408:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460500.344411:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460500.344471:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:11421:x1875336462667136:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 268us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.344492:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 148 00000100:00100000:1.0:1788460500.362325:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460500.362641:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462667392 00000100:00100000:0.0:1788460500.362660:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462667392 00000100:00100000:0.0:1788460500.362715:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:0.0:1788460500.362724:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:11421:x1875336462667392:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1788460500.362965:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:11421:x1875336462667392:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 241us (651us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788460500.362973:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00010000:00010000:2.0:1788460500.365662:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460500.476282:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.477261:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462667648 00000100:00100000:2.0:1788460500.477271:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462667648 00000100:00100000:2.0:1788460500.477329:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:2.0:1788460500.477336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+33:11431:x1875336462667648:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460500.477365:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.477382:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14c4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460500.477458:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788460500.477566:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14c4 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.477580:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:2.0:1788460500.477583:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460500.477588:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14c4 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.477603:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009e00, rc 0) 00000100:00100000:2.0:1788460500.477668:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11431:x1875336462667648:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 330us (1393us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788460500.477674:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:2.0:1788460500.481433:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460500.481735:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462667776 00000100:00100000:1.0:1788460500.481745:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462667776 00000100:00100000:1.0:1788460500.481798:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 150 00000100:00100000:1.0:1788460500.481808:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11431:x1875336462667776:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1788460500.481879:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.481897:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.481908:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.481922:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.481930:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482151:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482271:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482281:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482289:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460500.482327:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482339:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482347:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482509:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482514:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460500.482519:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482525:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482537:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:1.0:1788460500.482546:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460500.482552:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482559:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7c28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482572:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482578:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482584:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482589:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460500.482592:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482597:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482604:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c34d0b00) 00010000:00010000:1.0:1788460500.482606:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460500.482609:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482615:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482632:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482643:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482649:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482654:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460500.482658:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482664:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482671:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460500.482674:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460500.482677:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460500.482682:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7c36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460500.482841:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11431:x1875336462667776:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1033us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460500.482849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 150 00000100:00100000:1.0:1788460500.489646:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.489866:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462668032 00000100:00100000:2.0:1788460500.489877:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462668032 00000100:00100000:2.0:1788460500.490111:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:2.0:1788460500.490136:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11431:x1875336462668032:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460500.490412:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:11431:x1875336462668032:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 277us (773us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788460500.490420:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:0.0:1788460500.531393:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.531491:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462668288 00000100:00100000:2.0:1788460500.531502:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462668288 00000100:00100000:2.0:1788460500.531558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:2.0:1788460500.531569:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:11434:x1875336462668288:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460500.531593:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.531611:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531681:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531695:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531716:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531731:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531739:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531745:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531869:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531877:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.531885:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460500.531894:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788460500.531995:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532003:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532010:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532016:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460500.532020:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532028:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532409:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460500.532412:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460500.532417:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532434:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7c44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532449:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532455:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532461:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532466:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460500.532469:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532475:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532542:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c3cb0f00) 00010000:00010000:2.0:1788460500.532545:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460500.532549:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532555:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532601:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532614:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.532627:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460500.532630:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460500.532632:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008a00, rc 0) 00000100:00100000:2.0:1788460500.532698:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:11434:x1875336462668288:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1131us (1316us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788460500.532706:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:1.0:1788460500.538364:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.538439:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462668416 00000100:00100000:2.0:1788460500.538449:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462668416 00000100:00100000:2.0:1788460500.538512:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:2.0:1788460500.538522:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d10d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:11434:x1875336462668416:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1788460500.538593:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538610:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538622:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538647:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538654:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538661:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538667:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460500.538685:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538692:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538704:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460500.538707:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460500.538711:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.538717:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.538784:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d10d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:11434:x1875336462668416:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 263us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460500.538791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:1.0:1788460500.546175:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.546301:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462668672 00000100:00100000:2.0:1788460500.546311:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462668672 00000100:00100000:2.0:1788460500.546356:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:2.0:1788460500.546365:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:11434:x1875336462668672:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460500.546599:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:11434:x1875336462668672:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 234us (432us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788460500.546607:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:0.0:1788460500.797318:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460500.797447:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462668928 00000100:00100000:3.0:1788460500.797458:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462668928 00000100:00100000:3.0:1788460500.797519:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:3.0:1788460500.797529:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:11465:x1875336462668928:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1788460500.797554:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460500.797573:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7c67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14d2 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.797665:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.797679:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.797692:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460500.797716:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788460500.797844:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7c67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d2 expref: 41 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.797863:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d2 expref: 40 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.797871:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:3.0:1788460500.797873:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460500.797877:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c400, rc 0) 00000100:00100000:3.0:1788460500.797942:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:11465:x1875336462668928:12345-192.168.203.32@tcp:101:cat.0 Request processed in 414us (633us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788460500.797950:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:1.0:1788460500.801402:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460500.801501:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.801528:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462669184 00000100:00100000:2.0:1788460500.801538:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462669184 00000100:00100000:2.0:1788460500.801596:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:2.0:1788460500.801606:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:11465:x1875336462669184:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:0.0:1788460500.801873:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462669312 00000100:00100000:0.0:1788460500.801879:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462669312 00000100:00100000:2.0:1788460500.801905:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+42:11465:x1875336462669184:12345-192.168.203.32@tcp:35:cat.0 Request processed in 298us (886us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788460500.801929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1788460500.801934:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1788460500.801946:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+41:2380:x1875336462669312:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460500.801958:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460500.801980:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d2 expref: 41 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.802011:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460500.802016:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460500.802056:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:2380:x1875336462669312:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 113us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460500.802072:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460500.855341:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.855460:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462669568 00000100:00100000:2.0:1788460500.855470:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462669568 00000100:00100000:2.0:1788460500.855567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 154 00000100:00100000:2.0:1788460500.855579:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:11471:x1875336462669568:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:2.0:1788460500.855605:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460500.855608:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788460500.855634:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7bd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14a8 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.855653:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460500.855658:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460500.855670:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14d9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.855783:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.855808:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.855817:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.855850:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.855862:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 40 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.855883:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482596352:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460500.855988:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c1254180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460500.857889:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482596352:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460500.857914:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460500.861612:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460500.861756:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462669696 00000100:00100000:3.0:1788460500.861765:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462669696 00010000:00010000:3.0:1788460500.861803:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 41 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460500.861840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:3.0:1788460500.861849:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+41:2379:x1875336462669696:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460500.861873:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460500.861880:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 41 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.861893:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 41 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.861943:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7c52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14cb expref: 41 pid: 5843 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.861959:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:3.0:1788460500.861964:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.861972:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.862134:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460500.862166:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460500.862307:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:2379:x1875336462669696:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 457us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460500.862315:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00010000:00010000:2.0:1788460500.862438:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.862447:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460500.862476:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788460500.862622:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7c7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.862637:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.862644:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460500.862647:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460500.862649:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009000, rc 0) 00000100:00100000:2.0:1788460500.862686:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:11471:x1875336462669568:12345-192.168.203.32@tcp:101:dd.0 Request processed in 7109us (7353us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788460500.862693:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 154 00000100:00100000:1.0:1788460500.867667:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460500.867742:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462669952 00000100:00100000:2.0:1788460500.867767:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462669952 00000100:00100000:2.0:1788460500.867828:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 155 00000100:00100000:2.0:1788460500.867840:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:11471:x1875336462669952:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:2.0:1788460500.868126:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.868145:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460500.868157:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460500.868251:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788460500.868276:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007494ed97 reply state 0000000023f832f7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460500.868285:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460500.868376:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:11471:x1875336462669952:12345-192.168.203.32@tcp:36:dd.0 Request processed in 538us (716us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788460500.868383:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 155 00000020:00080000:2.0:1788460500.868388:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788460500.870799:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.870818:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.870826:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.871069:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460500.871075:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.871083:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.871099:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460500.871102:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460500.871107:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460500.871113:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7c91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460501.071532:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.071751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462670080 00000100:00100000:3.0:1788460501.071763:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462670080 00000100:00100000:3.0:1788460501.071844:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:3.0:1788460501.071855:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+42:11485:x1875336462670080:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:3.0:1788460501.071883:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460501.071907:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7c98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788460501.072086:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460501.072159:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072231:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072244:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072259:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072267:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072272:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072363:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072375:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072383:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072420:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.072434:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 43 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460501.072461:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482596480:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460501.072694:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788460501.075484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.075866:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482596480:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460501.075893:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460501.078446:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462670336 00000100:00100000:0.0:1788460501.078480:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462670336 00000100:00100000:0.0:1788460501.078558:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:0.0:1788460501.078568:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:5619:x1875336462670336:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788460501.078920:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:5619:x1875336462670336:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 352us (3442us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788460501.078928:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:1.0:1788460501.082277:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460501.082422:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462670464 00000100:00100000:0.0:1788460501.082431:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462670464 00010000:00010000:0.0:1788460501.082470:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 45 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460501.082507:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:0.0:1788460501.082516:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:2379:x1875336462670464:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460501.082529:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460501.082535:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 45 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.082555:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 45 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.082575:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7c83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14d9 expref: 45 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.082591:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460501.082596:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.082622:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.082630:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.082657:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460501.082709:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:2379:x1875336462670464:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 193us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460501.082716:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00010000:00010000:1.0:1788460501.083378:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083389:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460501.083440:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788460501.083444:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460501.083463:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083475:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083485:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083491:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083497:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083502:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460501.083506:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083512:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083531:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:1.0:1788460501.083533:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460501.083538:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083614:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7c9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083628:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083633:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083639:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083645:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460501.083648:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083654:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083662:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c52ed100) 00010000:00010000:1.0:1788460501.083664:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460501.083667:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083673:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083725:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7c98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e0 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083739:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e0 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.083747:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460501.083749:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460501.083752:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c600, rc 0) 00000100:00100000:1.0:1788460501.083850:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:11485:x1875336462670080:12345-192.168.203.32@tcp:101:stat.0 Request processed in 11997us (12327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460501.083858:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 156 00000100:00100000:1.0:1788460501.183014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460501.183129:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462670720 00000100:00100000:2.0:1788460501.183140:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462670720 00000100:00100000:2.0:1788460501.183235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 157 00000100:00100000:2.0:1788460501.183246:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:11491:x1875336462670720:12345-192.168.203.32@tcp:36:truncate.0 00010000:00010000:2.0:1788460501.183300:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460501.183325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7cad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e0 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.183363:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460501.183368:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460501.183594:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.183608:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.183618:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460501.183670:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788460501.183696:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000013dd783 reply state 000000002c09c7f0 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460501.183704:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460501.183797:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:11491:x1875336462670720:12345-192.168.203.32@tcp:36:truncate.0 Request processed in 552us (793us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788460501.183805:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 157 00000020:00080000:2.0:1788460501.183810:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788460501.189697:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.189715:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.189722:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.189728:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460501.189733:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.189741:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.189777:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460501.189780:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460501.189785:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.189790:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460501.351336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460501.351721:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462670848 00000100:00100000:2.0:1788460501.351733:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462670848 00000100:00100000:2.0:1788460501.351796:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 158 00000100:00100000:2.0:1788460501.351806:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc2d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:11505:x1875336462670848:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:2.0:1788460501.351834:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460501.351855:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7cbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14e7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.351962:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.351976:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.351987:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.352002:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.352009:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.352015:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.352125:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.352134:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.352141:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460501.352539:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788460501.352545:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460501.352571:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352583:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352591:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352598:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352605:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352611:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460501.352615:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352623:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352649:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460501.352652:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460501.352658:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352664:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7cc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352678:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352684:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352690:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352696:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460501.352698:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352705:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352712:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c3cb0f00) 00010000:00010000:3.0:1788460501.352714:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460501.352717:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352723:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352766:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b7cbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352780:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.352787:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:3.0:1788460501.352789:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460501.352791:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009e00, rc 0) 00000100:00100000:3.0:1788460501.352863:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc2d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:11505:x1875336462670848:12345-192.168.203.32@tcp:101:stat.0 Request processed in 1059us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460501.352872:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 158 00010000:00010000:3.0:1788460501.388865:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460501.451527:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460501.452484:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462671104 00000100:00100000:0.0:1788460501.452496:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462671104 00000100:00100000:0.0:1788460501.452557:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 159 00000100:00100000:0.0:1788460501.452566:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+45:11515:x1875336462671104:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460501.452649:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460501.452669:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14ee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460501.452755:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788460501.452861:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7cd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14ee expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.452875:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:0.0:1788460501.452878:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460501.452883:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14ee expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.452895:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a600, rc 0) 00000100:00100000:0.0:1788460501.454634:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+46:11515:x1875336462671104:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2058us (3105us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788460501.454646:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 159 00000100:00100000:2.0:1788460501.461287:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460501.461479:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462671360 00000100:00100000:1.0:1788460501.461490:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462671360 00000100:00100000:1.0:1788460501.461549:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1788460501.461559:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2869c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+46:11515:x1875336462671360:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460501.461806:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2869c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:11515:x1875336462671360:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 248us (527us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788460501.461814:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1788460501.530358:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.530445:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462671616 00000100:00100000:3.0:1788460501.530456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462671616 00000100:00100000:3.0:1788460501.530524:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 160 00000100:00100000:3.0:1788460501.530535:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+47:11521:x1875336462671616:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460501.530559:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460501.530579:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7ce5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14f5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.530678:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.530693:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.530719:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.530754:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.530767:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 48 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460501.530780:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482596608:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460501.530891:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e898a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460501.534391:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5870700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482596608:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460501.534421:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460501.535961:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460501.536079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462671744 00000100:00100000:2.0:1788460501.536089:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462671744 00010000:00010000:2.0:1788460501.536140:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 49 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460501.536208:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:2.0:1788460501.536219:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+49:2382:x1875336462671744:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460501.536233:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460501.536240:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 49 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.536252:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 49 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.536273:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7cd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14e7 expref: 49 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.536289:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460501.536294:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.536303:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.536310:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.536386:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460501.536435:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:2382:x1875336462671744:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 218us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460501.536443:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00010000:00010000:0.0:1788460501.537783:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.537798:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460501.537822:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788460501.538115:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7ce5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.538137:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.538147:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460501.538150:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460501.538153:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c800, rc 0) 00000100:00100000:0.0:1788460501.538309:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:11521:x1875336462671616:12345-192.168.203.32@tcp:101:bash.0 Request processed in 7774us (7961us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788460501.538318:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 160 00000100:00100000:1.0:1788460501.541638:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.541740:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462672000 00000100:00100000:3.0:1788460501.541752:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462672000 00000100:00100000:3.0:1788460501.541845:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 161 00000100:00100000:3.0:1788460501.541856:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:11521:x1875336462672000:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:3.0:1788460501.542156:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.542175:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.542410:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460501.542491:0:7007:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788460501.542519:0:7007:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004be75a61 reply state 000000003f738dfc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460501.542528:0:7007:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460501.542623:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:11521:x1875336462672000:12345-192.168.203.32@tcp:36:bash.0 Request processed in 767us (993us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788460501.542632:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 161 00000020:00080000:3.0:1788460501.542637:0:7007:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788460501.549239:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:0.0:1788460501.549743:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.549756:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.549764:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.549788:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029da00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460501.549794:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.549802:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.549821:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460501.549824:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460501.549830:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.549837:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7cfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460501.549898:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462672128 00000100:00100000:1.0:1788460501.549910:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462672128 00000100:00100000:1.0:1788460501.550131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:1.0:1788460501.550142:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:11521:x1875336462672128:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460501.550165:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460501.550214:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7d01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d14fc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.550312:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.550326:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.550334:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.550372:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.550386:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 51 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460501.550399:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482596736:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460501.550496:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460501.553130:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460501.553297:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462672256 00000100:00100000:2.0:1788460501.553307:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462672256 00010000:00010000:2.0:1788460501.553347:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 52 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460501.553384:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:2.0:1788460501.553394:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:2379:x1875336462672256:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460501.553408:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460501.553415:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 52 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.553428:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 52 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.553453:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460501.553458:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.553468:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.553488:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.553508:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460501.553556:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:2379:x1875336462672256:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 163us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460501.553563:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00010000:00010000:3.0:1788460501.553792:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7cec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14f5 expref: 51 pid: 5844 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460501.553809:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482596736:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460501.553830:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.553839:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.553845:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460501.553891:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788460501.553896:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460501.553917:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.553944:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7d01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14fc expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.553973:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14fc expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.553981:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:3.0:1788460501.553984:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460501.553987:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5600, rc 0) 00000100:00100000:3.0:1788460501.554029:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:11521:x1875336462672128:12345-192.168.203.32@tcp:101:bash.0 Request processed in 3889us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460501.554218:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 162 00000100:00100000:1.0:1788460501.557427:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.557594:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462672512 00000100:00100000:3.0:1788460501.557605:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462672512 00000100:00100000:3.0:1788460501.557659:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1788460501.557668:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:11521:x1875336462672512:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:3.0:1788460501.557962:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:11521:x1875336462672512:12345-192.168.203.32@tcp:35:bash.0 Request processed in 294us (542us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788460501.557970:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:2.0:1788460501.644976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460501.645093:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462672768 00000100:00100000:0.0:1788460501.645104:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462672768 00000100:00100000:0.0:1788460501.645164:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:0.0:1788460501.645176:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:11531:x1875336462672768:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460501.645235:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460501.645257:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1503 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460501.645346:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788460501.645474:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1503 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.645501:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:0.0:1788460501.645519:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460501.645526:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1503 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.645540:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a600, rc 0) 00000100:00100000:0.0:1788460501.645596:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11531:x1875336462672768:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 423us (632us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788460501.645603:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:2.0:1788460501.648641:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460501.648804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462672896 00000100:00100000:0.0:1788460501.648814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462672896 00000100:00100000:0.0:1788460501.648869:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:0.0:1788460501.648878:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11531:x1875336462672896:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1788460501.648961:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.648977:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.648989:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649002:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649009:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649015:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649116:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649138:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649145:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460501.649387:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649400:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649406:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649414:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649419:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460501.649424:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649431:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649442:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460501.649445:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460501.649449:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649455:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649473:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649479:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649485:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649490:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460501.649492:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649498:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649504:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650d2c3cc00) 00010000:00010000:0.0:1788460501.649506:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460501.649508:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649514:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649525:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649530:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649536:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649544:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460501.649547:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649553:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649559:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460501.649561:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460501.649564:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.649569:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460501.649685:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11531:x1875336462672896:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 806us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460501.649694:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:1.0:1788460501.653270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460501.653367:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462673152 00000100:00100000:0.0:1788460501.653378:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462673152 00000100:00100000:0.0:1788460501.653435:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:0.0:1788460501.653446:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11531:x1875336462673152:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:0.0:1788460501.653678:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:11531:x1875336462673152:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 233us (417us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788460501.653686:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1788460501.693497:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460501.693807:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462673408 00000100:00100000:0.0:1788460501.693817:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462673408 00000100:00100000:0.0:1788460501.693910:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:0.0:1788460501.693949:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+53:11534:x1875336462673408:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460501.693977:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460501.693997:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d150a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694281:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694295:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694306:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694320:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694326:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694332:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694451:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694457:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460501.694590:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788460501.694678:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694685:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694693:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694699:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460501.694703:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694711:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694723:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460501.694726:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460501.694731:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694737:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a800/0x889bb893541b7d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694749:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694755:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694773:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694777:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460501.694780:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694787:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694795:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650d2c3cc00) 00010000:00010000:0.0:1788460501.694797:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460501.694800:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694806:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694852:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d150a expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694867:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d150a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.694874:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460501.694877:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460501.694879:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a600, rc 0) 00000100:00100000:0.0:1788460501.694985:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11534:x1875336462673408:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1039us (1497us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788460501.695001:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 165 00000100:00100000:3.0:1788460501.698682:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.698771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460501.698858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462673536 00000100:00100000:1.0:1788460501.698868:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462673536 00000100:00100000:1.0:1788460501.698920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:1.0:1788460501.698935:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11534:x1875336462673536:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1788460501.698999:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699045:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699069:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699097:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699105:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699112:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699117:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460501.699122:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699129:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699140:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460501.699143:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460501.699148:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460501.699155:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460501.699249:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11534:x1875336462673536:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 320us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460501.699262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 166 00000100:00100000:1.0:1788460501.701613:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460501.701693:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462673920 00000100:00100000:2.0:1788460501.701704:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462673920 00000100:00100000:2.0:1788460501.701763:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:2.0:1788460501.701773:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11534:x1875336462673920:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460501.702216:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:11534:x1875336462673920:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 443us (611us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788460501.702225:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:0.0:1788460501.702288:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462673664 00000100:00100000:0.0:1788460501.702293:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462673664 00000100:00100000:0.0:1788460501.702333:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460501.702341:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:2382:x1875336462673664:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460501.702351:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460501.702371:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7d47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d150a expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.702388:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460501.702393:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460501.702412:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:2382:x1875336462673664:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 72us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460501.702419:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1788460501.835438:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460501.835543:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462674176 00000100:00100000:2.0:1788460501.835554:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462674176 00000100:00100000:2.0:1788460501.835613:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:2.0:1788460501.835624:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11553:x1875336462674176:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:2.0:1788460501.835650:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460501.835670:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7d5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1511 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.835766:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7d63 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.835782:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7d63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.835795:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7d63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460501.835805:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788460501.835950:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1511 expref: 58 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.835983:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7d63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1511 expref: 57 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460501.835991:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460501.835994:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788460501.835998:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009200, rc 0) 00000100:00100000:2.0:1788460501.836072:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11553:x1875336462674176:12345-192.168.203.32@tcp:101:cat.0 Request processed in 449us (641us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788460501.836080:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 167 00000100:00100000:1.0:1788460501.863461:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.863569:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462674304 00000100:00100000:3.0:1788460501.863580:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462674304 00000100:00100000:3.0:1788460501.863642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:3.0:1788460501.863654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11554:x1875336462674304:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460501.863681:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460501.863704:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1518 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.863785:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b7d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.863799:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.863810:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460501.863846:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788460501.863849:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460501.863867:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b7d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.863893:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1518 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.863909:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b7d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1518 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.863916:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460501.863919:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460501.863922:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029ce00, rc 0) 00000100:00100000:3.0:1788460501.863999:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11554:x1875336462674304:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 347us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460501.864007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 168 00000100:00100000:1.0:1788460501.869230:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.869354:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462674688 00000100:00100000:3.0:1788460501.869365:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462674688 00000100:00100000:3.0:1788460501.869428:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:3.0:1788460501.869438:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11554:x1875336462674688:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1788460501.869772:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11554:x1875336462674688:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 335us (549us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788460501.869780:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1788460501.872236:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460501.872352:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462674816 00000100:00100000:0.0:1788460501.872362:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462674816 00000100:00100000:0.0:1788460501.872464:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1788460501.872485:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11554:x1875336462674816:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:0.0:1788460501.872500:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788460501.872525:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14fc expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.872550:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b7d63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1511 expref: 58 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.872564:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b7c13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d14bd expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460501.872583:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460501.872594:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460501.872700:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:11554:x1875336462674816:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 226us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460501.872708:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1788460501.874428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.874505:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462674944 00000100:00100000:3.0:1788460501.874514:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462674944 00000100:00100000:3.0:1788460501.874571:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:3.0:1788460501.874581:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:11554:x1875336462674944:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:3.0:1788460501.874685:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.874701:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.874712:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460501.874901:0:7007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788460501.874992:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:11554:x1875336462674944:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 411us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460501.874999:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 169 00000100:00100000:1.0:1788460501.901090:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460501.901275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462675072 00000100:00100000:3.0:1788460501.901286:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462675072 00000100:00100000:3.0:1788460501.901340:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 170 00000100:00100000:3.0:1788460501.901348:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:11556:x1875336462675072:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460501.901368:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460501.901388:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7d86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d151f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901469:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901494:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901505:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901520:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901526:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901533:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901631:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901640:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901649:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460501.901682:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788460501.901687:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460501.901703:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901725:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901734:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901740:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901746:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901752:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460501.901757:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901765:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901776:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460501.901779:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460501.901784:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901791:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901803:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901808:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901819:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901824:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460501.901827:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901834:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901842:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c52ed200) 00010000:00010000:3.0:1788460501.901844:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460501.901847:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901852:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901881:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7d86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901894:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460501.901901:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed500) 00010000:00010000:3.0:1788460501.901904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460501.901906:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460501.901986:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11556:x1875336462675072:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 638us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460501.902002:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 170 00010000:00010000:1.0:1788460502.416572:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460502.476415:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460502.476425:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460502.476631:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788460502.476640:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460502.476967:0:11722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482596864:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788460502.477073:0:11722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5285840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460502.480943:0:11722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482596864:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788460502.485888:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.485934:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462675200 00000100:00100000:2.0:1788460502.485943:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462675200 00000100:00100000:2.0:1788460502.485995:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:2.0:1788460502.486005:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11568:x1875336462675200:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460502.486038:0:7007:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788460502.486147:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11568:x1875336462675200:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 144us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460502.486155:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 171 00000100:00100000:1.0:1788460502.510164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460502.511080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462675328 00000100:00100000:3.0:1788460502.511092:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462675328 00000100:00100000:3.0:1788460502.511158:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:3.0:1788460502.511169:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11568:x1875336462675328:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788460502.511270:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511286:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511299:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511325:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511333:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511340:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511364:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511373:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511379:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460502.511426:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788460502.511431:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460502.511442:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511453:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511461:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511468:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511475:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029da00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460502.511479:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511485:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511498:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:3.0:1788460502.511501:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460502.511507:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511512:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7da2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511523:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511539:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511544:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511549:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460502.511553:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511559:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511568:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9650c52ed200) 00010000:00010000:3.0:1788460502.511571:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460502.511574:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511579:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7da9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511593:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511599:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511605:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511609:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460502.511620:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511626:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511634:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed500) 00010000:00010000:3.0:1788460502.511636:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460502.511639:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.511645:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460502.511730:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11568:x1875336462675328:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 563us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460502.511740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 172 00000100:00100000:2.0:1788460502.514745:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460502.516528:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462675584 00000100:00100000:3.0:1788460502.516542:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462675584 00000100:00100000:3.0:1788460502.516912:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:3.0:1788460502.517021:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11568:x1875336462675584:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460502.517044:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460502.517075:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7db7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1526 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517167:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517426:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517454:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460502.517467:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788460502.517556:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517564:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517571:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517576:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460502.517581:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517587:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517599:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed500) 00010000:00010000:3.0:1788460502.517602:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460502.517607:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517613:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517653:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7db7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1526 expref: 59 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517674:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:3.0:1788460502.517676:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460502.517680:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7db7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1526 expref: 59 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.517689:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c000, rc 0) 00000100:00100000:3.0:1788460502.517872:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11568:x1875336462675584:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 951us (3136us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788460502.517880:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 173 00000100:00100000:1.0:1788460502.529478:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.534000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462675712 00000100:00100000:0.0:1788460502.534014:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462675712 00000100:00100000:1.0:1788460502.537616:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:1.0:1788460502.537631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11568:x1875336462675712:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788460502.537672:0:5844:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788460502.538078:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11568:x1875336462675712:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 449us (8609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460502.538086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 174 00000100:00100000:3.0:1788460502.540687:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482596992:0@lo:400:kworker.0 00000004:00080000:1.0:1788460502.540920:0:6728:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375776739964ns, next at 376776737911ns, rc = 0 00000100:00100000:0.0:1788460502.543260:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.543296:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462675968 00000100:00100000:0.0:1788460502.543304:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462675968 00000100:00100000:0.0:1788460502.543348:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:0.0:1788460502.543356:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11568:x1875336462675968:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460502.543373:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460502.543376:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788460502.543403:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b7d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1518 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.543421:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460502.543427:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460502.543441:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7dcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d152d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788460502.545317:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788460502.545525:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.545541:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.545563:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.545627:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7dcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d152d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.545646:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d152d expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.545654:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:0.0:1788460502.545657:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460502.545661:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5aa00, rc 0) 00000100:00100000:0.0:1788460502.547058:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11568:x1875336462675968:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 3684us (3795us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788460502.547070:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 175 00000100:00100000:3.0:1788460502.548712:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482597376:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.548778:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.548839:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482597888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460502.548868:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.548908:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482597120:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.548955:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.548984:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482597632:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.549008:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460502.549064:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482597376 00000100:00100000:0.0:1788460502.549073:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482597376 00000100:00100000:0.0:1788460502.549120:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482597632 00000100:00100000:0.0:1788460502.549122:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482597632 00000100:00100000:0.0:1788460502.549143:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788460502.549151:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482597376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460502.549223:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482597376:12345-0@lo:400:kworker.0 Request processed in 72us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460502.549230:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788460502.549245:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788460502.549252:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482597632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460502.549292:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482597632:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460502.549299:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788460502.549316:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460502.549319:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460502.549349:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482597376:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.549682:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482597632:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.549697:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788460502.549704:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482597248:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.549727:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.549752:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482597760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460502.549774:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.549887:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482597888 00000100:00100000:3.0:1788460502.549892:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482597888 00000100:00100000:3.0:1788460502.549913:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482597760 00000100:00100000:3.0:1788460502.549916:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482597760 00000100:00100000:3.0:1788460502.549928:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788460502.549935:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482597888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460502.549961:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460502.549995:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482597888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460502.550001:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788460502.550014:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460502.550270:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482597888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460502.551157:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482597760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460502.551207:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460502.551913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482597120 00000100:00100000:1.0:1788460502.551922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482597120 00000100:00100000:3.0:1788460502.552544:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482597760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2519us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460502.552554:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788460502.552633:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482597760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460502.552796:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482597248 00000100:00100000:1.0:1788460502.552803:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482597248 00000100:00100000:0.0:1788460502.553036:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788460502.553058:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482597120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460502.553116:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482597120:12345-0@lo:400:kworker.0 Request processed in 71us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460502.553124:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788460502.553263:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460502.553303:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788460502.553311:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482597248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460502.553348:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482597248:12345-0@lo:400:kworker.0 Request processed in 39us (3619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460502.553354:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788460502.553865:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482597248:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.553882:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482597120:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.553931:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.553969:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482597504:0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.554003:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.554350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482596992 00000100:00100000:3.0:1788460502.554364:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482596992 00000100:00100000:3.0:1788460502.554402:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788460502.554409:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482596992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460502.554451:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3319:x1875336482596992:12345-0@lo:400:kworker.0 Request processed in 42us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460502.554458:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788460502.554488:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482597504 00000100:00100000:2.0:1788460502.554492:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482597504 00000100:00100000:3.0:1788460502.554494:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482596992:0@lo:400:kworker.0 00000100:00100000:2.0:1788460502.554535:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788460502.554542:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482597504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460502.554588:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482597504:12345-0@lo:400:kworker.0 Request processed in 47us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460502.554602:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788460502.554809:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460502.555138:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482597504:0@lo:400:kworker.0 00000100:00100000:1.0:1788460502.563169:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460502.563229:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462676224 00000100:00100000:1.0:1788460502.563239:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462676224 00000100:00100000:1.0:1788460502.563291:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00100000:1.0:1788460502.563301:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11568:x1875336462676224:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460502.563356:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460502.563382:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d152d expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563401:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650d2c3c100) 00010000:00010000:1.0:1788460502.563410:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460502.563432:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563446:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563456:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563484:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563501:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563509:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563571:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563578:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563585:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563591:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460502.563596:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563603:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563611:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:1.0:1788460502.563614:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460502.563618:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563623:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7de1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563633:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563645:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563651:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563656:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460502.563660:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563666:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563674:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4da06e4b (ffff9650c34d0b00) 00010000:00010000:1.0:1788460502.563676:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460502.563679:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.563685:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7de8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4da06e4b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460502.563760:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11568:x1875336462676224:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 460us (608us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460502.563767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 176 00000100:00100000:1.0:1788460502.569312:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.570640:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462676352 00000100:00100000:2.0:1788460502.570652:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462676352 00000100:00100000:2.0:1788460502.570715:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:2.0:1788460502.570725:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11568:x1875336462676352:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460502.570745:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460502.570767:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7def lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1534 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.570801:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.570815:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.570826:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.570921:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b7def lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.571063:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.571072:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460502.571075:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460502.571078:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009e00, rc 0) 00000100:00100000:2.0:1788460502.571144:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11568:x1875336462676352:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 419us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460502.575803:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 177 00000100:00100000:0.0:1788460502.578637:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.578711:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462676608 00000100:00100000:2.0:1788460502.578721:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462676608 00000100:00100000:2.0:1788460502.578777:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 178 00000100:00100000:2.0:1788460502.578787:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11568:x1875336462676608:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788460502.578867:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.578885:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.578898:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460502.579411:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788460502.579426:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375815245546ns, next at 376815242237ns, rc = 0 00000004:00010000:2.0:1788460502.579529:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc50fb56 reply state 000000000de9ce3c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.579541:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460502.579641:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11568:x1875336462676608:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 853us (1012us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788460502.579649:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 178 00000100:00100000:1.0:1788460502.590601:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1788460502.590637:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590649:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590666:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590673:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460502.590679:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590687:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590702:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460502.590706:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788460502.590711:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590718:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009c00/0x889bb893541b7dfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460502.590747:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462676736 00000100:00100000:1.0:1788460502.590755:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462676736 00000100:00100000:1.0:1788460502.590801:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 179 00000100:00100000:1.0:1788460502.590810:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11568:x1875336462676736:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460502.590834:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460502.590850:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d153b expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590902:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 61 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590927:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 61 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.590944:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460502.590946:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460502.590948:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5600, rc 0) 00000100:00100000:1.0:1788460502.590998:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11568:x1875336462676736:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 189us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460502.591005:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 179 00000100:00100000:3.0:1788460502.595338:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.596341:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462676864 00000100:00100000:0.0:1788460502.596353:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462676864 00000100:00100000:0.0:1788460502.596424:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1788460502.596435:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462676864:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788460502.596732:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460502.596960:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462676864:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 525us (1772us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788460502.596968:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:1.0:1788460502.604035:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460502.604164:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462677120 00000100:00100000:3.0:1788460502.604174:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462677120 00000100:00100000:3.0:1788460502.604260:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1788460502.604270:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11568:x1875336462677120:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788460502.604484:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11568:x1875336462677120:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 214us (455us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788460502.604492:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1788460502.607706:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.607870:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462677376 00000100:00100000:2.0:1788460502.607882:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462677376 00000100:00100000:2.0:1788460502.607964:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:2.0:1788460502.607975:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11568:x1875336462677376:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788460502.608116:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11568:x1875336462677376:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 142us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460502.608129:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 180 00000100:00100000:3.0:1788460502.612639:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460502.613228:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462677504 00000100:00100000:1.0:1788460502.613239:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462677504 00000100:00100000:1.0:1788460502.613293:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 181 00000100:00100000:1.0:1788460502.613302:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11568:x1875336462677504:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460502.613324:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460502.613343:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1542 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.613408:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.613422:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.613433:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460502.613481:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460502.613499:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.613526:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1542 expref: 64 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.613542:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1542 expref: 63 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.613551:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460502.613554:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788460502.613558:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5400, rc 0) 00000100:00100000:1.0:1788460502.613612:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+63:11568:x1875336462677504:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 310us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460502.613619:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 181 00000001:00080000:2.0:1788460502.617896:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1788460502.617914:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788460502.628220:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.628299:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462677632 00000100:00100000:2.0:1788460502.628310:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462677632 00000100:00100000:2.0:1788460502.628359:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:2.0:1788460502.628370:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462677632:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460502.628386:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460502.628406:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1549 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460502.628432:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bdd5, blocks: 0x1 00010000:00010000:2.0:1788460502.628450:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1788460502.628454:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460502.628464:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.628481:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.628495:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009000, rc 0) 00000100:00100000:2.0:1788460502.628545:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462677632:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 177us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460502.628552:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000040:00080000:2.0:1788460502.636629:0:12546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788460502.636643:0:12546:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788460502.636685:0:12546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788460502.636691:0:12546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460502.642127:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.642221:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462677888 00000100:00100000:0.0:1788460502.642231:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462677888 00000100:00100000:0.0:1788460502.642289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 182 00000100:00100000:0.0:1788460502.642300:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+63:11568:x1875336462677888:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788460502.642403:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+63:11568:x1875336462677888:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460502.642420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 182 00000100:00100000:2.0:1788460502.645416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.645495:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462678016 00000100:00100000:0.0:1788460502.645504:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462678016 00000100:00100000:0.0:1788460502.645556:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:0.0:1788460502.645566:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:11568:x1875336462678016:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460502.645582:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460502.645600:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1550 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.645630:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.645640:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460502.645645:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460502.645650:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 9 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.645682:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.645696:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 9 pid: 6700 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460502.645710:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8864:1875336482598016:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460502.645790:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d91263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460502.657141:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.657206:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462678144 00000100:00100000:0.0:1788460502.657216:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462678144 00010000:00010000:0.0:1788460502.657260:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 10 pid: 6700 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460502.657300:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:0.0:1788460502.657310:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2379:x1875336462678144:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460502.657324:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460502.657348:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 10 pid: 6700 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.657363:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 10 pid: 6700 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.657388:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460502.657392:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460502.657401:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 10 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.657413:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 10 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.657451:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 10 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460502.657466:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1875336482598144:192.168.203.32@tcp:105: 00000100:00100000:0.0:1788460502.657558:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d9126240 going to sleep for 11 seconds 00010000:00010000:3.0:1788460502.658106:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b7e19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1549 expref: 10 pid: 6700 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460502.658124:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8864:1875336482598016:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460502.658146:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 9 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460502.658171:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a800, rc 0) 00000100:00100000:3.0:1788460502.662770:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:11568:x1875336462678016:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 17196us (17353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460502.662783:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:1.0:1788460502.669370:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1875336482598144:192.168.203.32@tcp:105: 00010000:00010000:1.0:1788460502.669396:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460502.669456:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462678144:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 12146us (12323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460502.669467:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:0.0:1788460502.694574:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460502.694652:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462678272 00000100:00100000:1.0:1788460502.694663:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462678272 00002000:00100000:1.0:1788460502.694714:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9650fded3100 x1875336462678272/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:658/0 lens 504/0 e 0 to 0 dl 1788460513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788460502.694739:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650fded3100 with x1875336462678272 ext(0->8) 00002000:00010000:1.0:1788460502.694744:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650fded3100 00000100:00100000:1.0:1788460502.694860:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460502.694871:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2380:x1875336462678272:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788460502.695507:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2380:x1875336462678272:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 635us (942us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788460502.695517:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00002000:00100000:1.0:1788460502.695524:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9650fded3100 x1875336462678272/t4294967315(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:658/0 lens 504/448 e 0 to 0 dl 1788460513 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788460502.695533:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650fded3100 with x1875336462678272 ext(0->8) 00002000:00010000:1.0:1788460502.695537:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650fded3100 00000100:00100000:2.0:1788460502.718231:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460502.718888:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462678400 00000100:00100000:3.0:1788460502.718899:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462678400 00000100:00100000:3.0:1788460502.719149:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 183 00000100:00100000:3.0:1788460502.719161:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+63:11568:x1875336462678400:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788460502.807129:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+63:11568:x1875336462678400:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 87960us (88899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460502.807143:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 183 00000001:00080000:3.0:1788460502.807200:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:3.0:1788460502.807224:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788460502.807245:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788460502.807253:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650fc96f900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788460502.807257:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650efbf9a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650fc96f780 00000020:00080000:3.0:1788460502.807260:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650efbf9100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9650fca05800 00000001:00080000:3.0:1788460502.807273:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788460502.807276:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1788460502.807320:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1788460502.807553:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788460502.807721:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788460502.807740:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482598272:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788460502.807789:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482598400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788460502.807791:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460502.807816:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460502.808173:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482598272 00000100:00100000:2.0:1788460502.808448:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482598272 00000100:00100000:2.0:1788460502.808487:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482598400 00000100:00100000:2.0:1788460502.808490:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482598400 00000100:00100000:2.0:1788460502.808551:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788460502.808564:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482598272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788460502.808588:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788460502.808621:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a99bdd3, atime: 0x6a99bdd3, ctime: 0x6a99bdd3, blocks: 0xb 00010000:00010000:2.0:1788460502.808629:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.808648:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788460502.808652:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460502.808658:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.808675:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.808686:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.808693:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.808724:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460502.809017:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460502.809025:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.809033:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460502.809037:0:7658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.809055:0:7658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.809073:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.809091:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b7e27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.809108:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460502.809110:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460502.809112:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460502.809658:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482598272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1096us (1863us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788460502.809668:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788460502.809691:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460502.809701:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482598400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788460502.809804:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788460502.809808:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788460501 00002000:00010000:2.0:1788460502.809811:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788460502.809813:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788460501 -> 1788460501 00002000:00010000:2.0:1788460502.809815:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788460502.809849:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482598400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (2031us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788460502.809856:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460502.810120:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460502.810143:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462678528 00000100:00100000:3.0:1788460502.810149:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462678528 00000100:00100000:3.0:1788460502.810190:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:3.0:1788460502.810198:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2379:x1875336462678528:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788460502.810828:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788460502.810837:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788460502.810859:0:3319:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9650fcd16a00 x1875336482598272/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788460518 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788460502.810871:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650fcd16a00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788460502.810876:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482598272:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788460502.815103:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650fcd15f80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788460502.815115:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482598400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788460502.847698:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2379:x1875336462678528:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 37489us (37569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460502.847715:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000001:00080000:2.0:1788460502.848419:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1788460502.848435:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1788460502.848444:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:3.0:1788460502.854295:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.854474:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462678784 00000100:00100000:0.0:1788460502.854485:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462678784 00000100:00100000:1.0:1788460502.854611:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 184 00000100:00100000:1.0:1788460502.854623:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11568:x1875336462678784:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460502.854678:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460502.854705:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1542 expref: 18 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.854725:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460502.854730:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460502.854757:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.854783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.854792:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460502.855151:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000285e3dd reply state 00000000bf871e48 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460502.855161:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460502.855401:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:11568:x1875336462678784:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 779us (1113us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788460502.855410:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 184 00010000:00010000:0.0:1788460502.856961:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.856979:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.856987:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.856993:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460502.856999:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.857008:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.857025:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:0.0:1788460502.857029:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460502.857034:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.857039:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460502.859005:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.859689:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462678912 00000100:00100000:2.0:1788460502.859701:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462678912 00000100:00100000:2.0:1788460502.859765:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:2.0:1788460502.859776:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462678912:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788460502.860024:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788460502.860041:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788460501 -> 1788460500 00002000:00010000:2.0:1788460502.860054:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788460499 00002000:00010000:2.0:1788460502.860057:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788460501 -> 1788460500 00002000:00010000:2.0:1788460502.860060:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788460502.860129:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462678912:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 355us (1133us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788460502.860137:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:3.0:1788460502.862770:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.862867:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462679168 00000100:00100000:2.0:1788460502.862876:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462679168 00000100:00100000:2.0:1788460502.862937:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:2.0:1788460502.862948:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11568:x1875336462679168:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788460502.863016:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.863033:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.863052:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.863089:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.863102:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 18 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.863115:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482598528:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460502.864092:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460502.867559:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482598528:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460502.867592:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460502.868595:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.868713:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462679296 00000100:00100000:2.0:1788460502.868722:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462679296 00010000:00010000:2.0:1788460502.868763:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 19 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.869379:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:2.0:1788460502.869392:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:2379:x1875336462679296:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460502.869407:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460502.869416:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 19 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.869430:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 19 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.869452:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b7df6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1534 expref: 19 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.869477:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:2.0:1788460502.869482:0:7669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.869492:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.869499:0:7669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.869546:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460502.869665:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869674:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869703:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869710:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869716:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869722:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460502.869726:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869742:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869751:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460502.869753:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788460502.869757:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.869762:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b7e35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.869903:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:2379:x1875336462679296:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 512us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460502.869911:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 76 00000100:00100000:1.0:1788460502.870058:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:11568:x1875336462679168:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 7110us (7296us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788460502.870066:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 185 00000100:00100000:3.0:1788460502.873749:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460502.873832:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462679424 00000100:00100000:2.0:1788460502.873842:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462679424 00000100:00100000:2.0:1788460502.874036:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:2.0:1788460502.874059:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462679424:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788460502.874114:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.874137:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 8 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.874146:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788460502.874150:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460502.874154:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.874229:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 8 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.874243:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 8 pid: 8864 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.874257:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482598656:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460502.874345:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460502.878213:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.878730:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462679552 00000100:00100000:0.0:1788460502.878755:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462679552 00010000:00010000:0.0:1788460502.878797:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 9 pid: 8864 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460502.878840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 77 00000100:00100000:0.0:1788460502.878848:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2380:x1875336462679552:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460502.878861:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460502.878882:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 9 pid: 8864 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.878896:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 9 pid: 8864 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.878930:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460502.878935:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460502.878941:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.878952:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.878972:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460502.879027:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2380:x1875336462679552:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 180us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460502.879035:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 77 00010000:00010000:2.0:1788460502.880431:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000714f9cea/0x889bb893541b7e20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1550 expref: 8 pid: 8864 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.880450:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1875336482598656:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460502.880531:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880543:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880551:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880582:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880591:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880599:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880606:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460502.880610:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880638:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880654:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.880661:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c020989/0x889bb893541b7e3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.880770:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2379:x1875336462679424:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 6723us (7030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460502.880779:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:1.0:1788460502.884882:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.885022:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462679808 00000100:00100000:0.0:1788460502.885040:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462679808 00000100:00100000:0.0:1788460502.885134:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 186 00000100:00100000:0.0:1788460502.885144:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+17:11568:x1875336462679808:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788460502.885255:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.885273:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.885284:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.885496:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.885508:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 18 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.885515:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.885547:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 18 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.885561:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 18 pid: 7007 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460502.885576:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482598784:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460502.885658:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4ea26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460502.891014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460502.891318:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462679936 00000100:00100000:1.0:1788460502.891327:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462679936 00010000:00010000:1.0:1788460502.891366:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 19 pid: 7007 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460502.891410:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 78 00000100:00100000:1.0:1788460502.891419:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:2379:x1875336462679936:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460502.891433:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460502.891440:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 19 pid: 7007 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.891452:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 19 pid: 7007 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.891506:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460502.891512:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.891521:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.891528:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.891552:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460502.891603:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:2379:x1875336462679936:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 185us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460502.891611:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 78 00010000:00010000:0.0:1788460502.892411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b7e04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d153b expref: 18 pid: 7007 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460502.892445:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482598784:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460502.892476:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.892486:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.892492:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460502.892669:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788460502.892814:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788460502.892859:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788460502.893175:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875336482598912:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788460502.893329:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460502.893364:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ca8df9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460502.894079:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482598912 00000100:00100000:3.0:1788460502.894088:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482598912 00000100:00100000:3.0:1788460502.894146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788460502.894157:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875336482598912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788460502.894284:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875336482598912:12345-0@lo:1000:mdt00_002.0 Request processed in 129us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460502.894292:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460502.894437:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788460502.894445:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650fcd15f80, transno 4294967316 00000100:00100000:1.0:1788460502.894464:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875336482598912:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788460502.895073:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788460502.895145:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875336482599040:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788460502.895213:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460502.895237:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460502.895567:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482599040 00000100:00100000:0.0:1788460502.895573:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482599040 00000100:00100000:0.0:1788460502.895608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460502.895616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875336482599040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788460502.895787:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875336482599040:12345-0@lo:1000:mdt00_002.0 Request processed in 170us (572us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788460502.895795:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460502.896653:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875336482599040:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788460502.896696:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896707:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896726:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896733:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460502.896738:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896746:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896760:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c3cb0800) 00010000:00010000:1.0:1788460502.896763:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460502.896767:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896773:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b7e4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896801:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896807:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896812:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896817:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460502.896820:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896835:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896843:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed500) 00010000:00010000:1.0:1788460502.896846:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460502.896849:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896856:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c800/0x889bb893541b7d7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896876:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896889:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.896898:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.897247:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.897262:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 21 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460502.897274:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482599168:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460502.897344:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d9126240 going to sleep for 11 seconds 00000100:00100000:1.0:1788460502.899847:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482599168:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460502.899891:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460502.901637:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460502.901706:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462680064 00000100:00100000:0.0:1788460502.901716:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462680064 00010000:00010000:0.0:1788460502.901758:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 22 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460502.901817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 79 00000100:00100000:0.0:1788460502.901827:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:2379:x1875336462680064:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460502.901842:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460502.901848:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 22 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.901860:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 22 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.901882:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b7d9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d151f expref: 22 pid: 5842 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.901899:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed500) 00010000:00010000:0.0:1788460502.901905:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.901914:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.901926:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460502.901962:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460502.902014:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:2379:x1875336462680064:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 189us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460502.902022:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 79 00010000:00010000:2.0:1788460502.902394:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902404:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902416:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902422:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902428:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902445:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460502.902450:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902458:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902473:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed500) 00010000:00010000:2.0:1788460502.902476:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460502.902479:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902485:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b7e51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902497:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902504:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902510:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902514:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460502.902517:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902523:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902542:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed500) 00010000:00010000:2.0:1788460502.902544:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460502.902548:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.902554:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b7e43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460502.902766:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:11568:x1875336462679808:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 17622us (17894us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788460502.902776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 186 00000020:00080000:2.0:1788460502.902780:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788460502.903016:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460502.903021:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460502.903579:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788460502.903589:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460502.906526:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460502.906861:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462680320 00000100:00100000:1.0:1788460502.906871:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462680320 00000100:00100000:1.0:1788460502.906935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1788460502.906945:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2868050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:11568:x1875336462680320:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788460502.907696:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788460502.907804:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788460502.907850:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.907866:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.907876:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.907884:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.907891:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.907897:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460502.907920:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788460502.908015:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2868050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:11568:x1875336462680320:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1069us (1495us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788460502.908025:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000020:00080000:1.0:1788460502.908030:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788460502.908214:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460502.908221:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.908228:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460502.908232:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.908241:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.908254:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9650c34d0600) 00010000:00010000:2.0:1788460502.908258:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788460502.908262:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.908268:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b7e58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460502.908301:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460502.908303:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460502.908304:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460503.436647:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460504.467106:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460504.556348:0:12599:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460504.556359:0:12599:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460504.556416:0:12599:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788460504.556422:0:12599:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460504.700362:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460504.700482:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462680576 00000100:00100000:0.0:1788460504.700501:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462680576 00000100:00100000:0.0:1788460504.700579:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00100000:0.0:1788460504.700589:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:11586:x1875336462680576:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460504.700617:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460504.700637:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b7e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1557 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.700731:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7e66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.700745:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.700756:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460504.700767:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788460504.700892:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b7e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1557 expref: 25 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.700924:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1557 expref: 24 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.700933:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460504.700936:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460504.700940:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b800, rc 0) 00000100:00100000:0.0:1788460504.700993:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:11586:x1875336462680576:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 405us (639us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788460504.701000:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 187 00000100:00080000:1.0:1788460504.701201:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460504.702979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460504.703103:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462680704 00000100:00100000:1.0:1788460504.703111:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462680704 00000100:00100000:1.0:1788460504.703169:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:1.0:1788460504.703208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:11586:x1875336462680704:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:1.0:1788460504.703287:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703302:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703312:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703328:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703334:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703341:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703599:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703613:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703620:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460504.703659:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703673:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703680:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703687:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703693:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460504.703698:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703706:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703717:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:1.0:1788460504.703720:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460504.703725:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703730:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7e74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703752:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703759:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703764:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703770:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460504.703774:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703780:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703789:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c34d0b00) 00010000:00010000:1.0:1788460504.703792:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460504.703796:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703802:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703822:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703829:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703835:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703847:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460504.703851:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703858:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703867:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c34d0300) 00010000:00010000:1.0:1788460504.703869:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460504.703871:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.703876:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460504.704434:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:11586:x1875336462680704:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1253us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460504.704445:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 188 00000100:00100000:3.0:1788460504.766591:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460504.766701:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462680960 00000100:00100000:0.0:1788460504.766711:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462680960 00000100:00100000:0.0:1788460504.766777:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:0.0:1788460504.766787:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+24:11589:x1875336462680960:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460504.766812:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460504.766830:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b7e89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d155e expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.766898:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.766924:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.766938:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.766953:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.766960:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.766966:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767245:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767254:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767269:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460504.767279:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788460504.767364:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767371:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767377:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767384:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460504.767388:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767394:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767404:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460504.767407:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460504.767412:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767417:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767428:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767433:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767444:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767449:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460504.767451:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767457:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767464:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650d2c3c600) 00010000:00010000:0.0:1788460504.767467:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460504.767470:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767475:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767519:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b7e89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 27 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767531:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 26 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.767537:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:0.0:1788460504.767539:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460504.767541:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b600, rc 0) 00000100:00100000:0.0:1788460504.767607:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11589:x1875336462680960:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 821us (1026us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788460504.767625:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 189 00000100:00100000:3.0:1788460504.770588:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460504.771946:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462681088 00000100:00100000:2.0:1788460504.771959:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462681088 00000100:00100000:2.0:1788460504.772045:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:2.0:1788460504.772056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11589:x1875336462681088:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1788460504.772123:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772140:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772153:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772226:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772234:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772242:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772249:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460504.772254:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772264:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772538:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:2.0:1788460504.772544:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460504.772549:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460504.772557:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7eac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460504.772716:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11589:x1875336462681088:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 660us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460504.772732:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 190 00000100:00100000:2.0:1788460504.778018:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460504.778381:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462681344 00000100:00100000:1.0:1788460504.778392:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462681344 00000100:00100000:1.0:1788460504.778499:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1788460504.778510:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11589:x1875336462681344:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460504.779624:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:11589:x1875336462681344:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1109us (1609us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788460504.779635:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1788460504.806327:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460504.806411:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462681600 00000100:00100000:0.0:1788460504.806421:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462681600 00000100:00100000:0.0:1788460504.806478:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:0.0:1788460504.806487:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:11114:x1875336462681600:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460504.806512:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460504.806531:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b7eb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1565 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.806630:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.806645:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 28 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.806654:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.806687:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 28 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.806699:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 28 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460504.806713:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fccf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482599296:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460504.806807:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d115ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460504.810229:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460504.810310:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462681728 00000100:00100000:1.0:1788460504.810320:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462681728 00010000:00010000:1.0:1788460504.810380:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 29 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460504.810424:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 80 00000100:00100000:1.0:1788460504.810434:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:2379:x1875336462681728:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460504.810448:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460504.810465:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 29 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.810479:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 29 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.810503:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:1.0:1788460504.810508:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.810518:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.810526:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.810546:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460504.810597:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:2379:x1875336462681728:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 165us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460504.810605:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 80 00010000:00010000:0.0:1788460504.811564:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7e9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d155e expref: 28 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460504.811600:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fccf2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482599296:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460504.811626:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.811636:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.811642:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460504.811661:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788460504.811805:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ba00/0x889bb893541b7eb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 29 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.812004:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 28 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.812014:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:0.0:1788460504.812016:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460504.812019:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b000, rc 0) 00000100:00100000:0.0:1788460504.812092:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:11114:x1875336462681600:12345-192.168.203.32@tcp:101:bash.0 Request processed in 5605us (5773us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788460504.812101:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 191 00000100:00100000:3.0:1788460504.814787:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460504.814876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462681984 00000100:00100000:1.0:1788460504.814887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462681984 00000100:00100000:1.0:1788460504.814952:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 192 00000100:00100000:1.0:1788460504.814970:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:11114:x1875336462681984:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:1.0:1788460504.815267:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.815287:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.815298:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788460504.815357:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788460504.815383:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a03bd7f4 reply state 00000000fbf6dbdd transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460504.815392:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788460504.815437:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788460504.815542:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:11114:x1875336462681984:12345-192.168.203.32@tcp:36:bash.0 Request processed in 572us (762us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788460504.815550:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 192 00000020:00080000:1.0:1788460504.815554:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788460504.817635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:1.0:1788460504.817672:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.817684:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.817703:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.817711:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460504.817715:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.817762:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.817787:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:1.0:1788460504.817790:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460504.817796:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.817802:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b7ec8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460504.818111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462682112 00000100:00100000:3.0:1788460504.818120:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462682112 00000100:00100000:3.0:1788460504.818175:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 193 00000100:00100000:3.0:1788460504.818219:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:11114:x1875336462682112:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460504.818240:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460504.818255:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7ecf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d156c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.818307:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7ecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d156c expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.818327:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7ecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d156c expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.818346:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:3.0:1788460504.818349:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460504.818351:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c000, rc 0) 00000100:00100000:3.0:1788460504.818401:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:11114:x1875336462682112:12345-192.168.203.32@tcp:101:bash.0 Request processed in 184us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460504.818407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 193 00000100:00100000:3.0:1788460504.821424:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460504.821544:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462682240 00000100:00100000:0.0:1788460504.821553:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462682240 00000100:00080000:1.0:1788460504.821596:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460504.821624:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:0.0:1788460504.821634:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:11114:x1875336462682240:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460504.821662:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460504.821679:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1573 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460504.821811:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a99bdd4, atime: 0x6a99bdd3, ctime: 0x6a99bdd4, blocks: 0xb 00010000:00010000:0.0:1788460504.821833:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788460504.821836:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460504.821843:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.821856:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.821865:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5ba00, rc 0) 00000100:00100000:0.0:1788460504.821952:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:11114:x1875336462682240:12345-192.168.203.32@tcp:101:bash.0 Request processed in 319us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460504.821958:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:1.0:1788460504.824274:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460504.824324:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462682368 00000100:00100000:3.0:1788460504.824332:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462682368 00002000:00010000:3.0:1788460504.824363:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788460504.824367:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650f5e7ca80 with x1875336462682368 ext(0->18446744073709551615) 00002000:00010000:3.0:1788460504.824375:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650f5e7ca80. 00000100:00100000:3.0:1788460504.824403:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1788460504.824409:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2379:x1875336462682368:12345-192.168.203.32@tcp:10:bash.0 00002000:00010000:3.0:1788460504.824687:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788460504.824690:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788460500 -> 1788460503 00002000:00010000:3.0:1788460504.824692:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788460499 -> 1788460499 00002000:00010000:3.0:1788460504.824694:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788460500 -> 1788460503 00002000:00010000:3.0:1788460504.824770:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788460504.824836:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2379:x1875336462682368:12345-192.168.203.32@tcp:10:bash.0 Request processed in 425us (567us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788460504.824843:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00002000:00010000:3.0:1788460504.824847:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788460504.824850:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650f5e7ca80 with x1875336462682368 ext(0->18446744073709551615) 00002000:00010000:3.0:1788460504.824854:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650f5e7ca80. 00000100:00100000:2.0:1788460504.890119:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460504.890222:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462682496 00000100:00100000:3.0:1788460504.890232:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462682496 00000100:00100000:3.0:1788460504.890289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:3.0:1788460504.890300:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:11603:x1875336462682496:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:3.0:1788460504.890375:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890394:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890406:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890421:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890428:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890464:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890690:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890938:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890946:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460504.890985:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.890996:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891002:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891009:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891015:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460504.891019:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891027:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891050:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460504.891061:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460504.891066:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891072:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891087:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891092:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891098:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891103:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460504.891105:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891110:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891117:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c52ed200) 00010000:00010000:3.0:1788460504.891119:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460504.891122:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891127:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891142:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891154:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891159:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891164:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460504.891167:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891172:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891239:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:3.0:1788460504.891242:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460504.891246:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.891252:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7eeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460504.891438:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:11603:x1875336462682496:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1137us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460504.891447:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 194 00000100:00100000:1.0:1788460504.929888:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460504.930137:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462682752 00000100:00100000:3.0:1788460504.930147:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462682752 00000100:00100000:3.0:1788460504.930234:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:3.0:1788460504.930245:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+32:11606:x1875336462682752:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460504.930268:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460504.930300:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7ef2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d157a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930370:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930386:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930397:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930412:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930420:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930426:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930682:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930692:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930699:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460504.930708:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788460504.930801:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930818:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930825:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930831:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460504.930836:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930844:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930855:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460504.930858:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460504.930863:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930869:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930882:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930888:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930894:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.930899:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460504.931573:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.931583:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.931594:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c52ed200) 00010000:00010000:3.0:1788460504.931597:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460504.931600:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.931607:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.931655:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7ef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d157a expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.931668:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d157a expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460504.931675:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:3.0:1788460504.931677:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788460504.931680:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029da00, rc 0) 00000100:00100000:3.0:1788460504.931757:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11606:x1875336462682752:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1514us (1878us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788460504.931766:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 195 00000100:00100000:2.0:1788460504.935421:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460504.935581:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462682880 00000100:00100000:1.0:1788460504.935592:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462682880 00000100:00100000:1.0:1788460504.935653:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:1.0:1788460504.935664:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11606:x1875336462682880:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:1.0:1788460504.935733:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.935750:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 34 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.935759:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.935793:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 34 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.935826:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 34 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460504.935841:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482599424:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460504.936090:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460504.943746:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482599424:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460504.943780:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460504.944468:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460504.944543:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462683136 00000100:00100000:3.0:1788460504.944551:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462683136 00000100:00100000:3.0:1788460504.944607:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1788460504.944617:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:5619:x1875336462683136:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788460504.944952:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:5619:x1875336462683136:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 335us (486us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788460504.944960:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:1.0:1788460504.947293:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460504.947863:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462683264 00000100:00100000:0.0:1788460504.947873:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462683264 00010000:00010000:0.0:1788460504.947914:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 36 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460504.948084:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 81 00000100:00100000:0.0:1788460504.948094:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:2380:x1875336462683264:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460504.948109:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460504.948117:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 36 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.948143:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 36 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.948165:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7eba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1565 expref: 36 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.948210:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:0.0:1788460504.948216:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.948225:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.948232:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460504.948265:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460504.948322:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:2380:x1875336462683264:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 229us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460504.948330:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 81 00010000:00010000:1.0:1788460504.948802:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948811:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948839:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948846:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948853:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948858:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460504.948863:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948869:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948879:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:1.0:1788460504.948890:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460504.948895:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460504.948901:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b7f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460504.948979:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11606:x1875336462682880:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 13316us (13566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460504.948987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 196 00000100:00100000:1.0:1788460504.951537:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460504.951619:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462683520 00000100:00100000:3.0:1788460504.951630:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462683520 00000100:00100000:3.0:1788460504.951699:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:3.0:1788460504.951710:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+34:11606:x1875336462683520:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1788460504.952165:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:11606:x1875336462683520:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 455us (635us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788460504.952174:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:3.0:1788460505.021936:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.022077:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462683776 00000100:00100000:0.0:1788460505.022087:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462683776 00000100:00100000:0.0:1788460505.022150:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:0.0:1788460505.022161:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+35:11617:x1875336462683776:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:0.0:1788460505.022211:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460505.022231:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7f1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1581 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022323:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022336:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022346:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022359:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022365:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022370:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022636:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022646:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022653:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460505.022663:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788460505.022752:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022759:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022772:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022779:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.022783:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022790:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022803:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460505.022806:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460505.022810:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022817:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022832:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022838:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022844:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022849:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.022852:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022869:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022878:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650d2c3cb00) 00010000:00010000:0.0:1788460505.022880:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460505.022883:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022889:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022934:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7f1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1581 expref: 38 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022950:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1581 expref: 37 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.022956:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:0.0:1788460505.022959:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460505.022961:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5aa00, rc 0) 00000100:00100000:0.0:1788460505.023037:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:11617:x1875336462683776:12345-192.168.203.32@tcp:101:cat.0 Request processed in 870us (1104us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788460505.023045:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 197 00000100:00100000:2.0:1788460505.028110:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.028227:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462684032 00000100:00100000:3.0:1788460505.028238:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462684032 00000100:00100000:2.0:1788460505.028387:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460505.028398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:11617:x1875336462684032:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:2.0:1788460505.028693:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:11617:x1875336462684032:12345-192.168.203.32@tcp:35:cat.0 Request processed in 295us (590us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788460505.028701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:1.0:1788460505.047497:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.047589:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462684288 00000100:00100000:3.0:1788460505.047599:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462684288 00000100:00100000:3.0:1788460505.047656:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 198 00000100:00100000:3.0:1788460505.047666:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:11618:x1875336462684288:12345-192.168.203.32@tcp:36:rm.0 00010000:00010000:3.0:1788460505.047727:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788460505.047753:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1581 expref: 38 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.047778:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d157a expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.047796:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7ecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d156c expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.047831:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650d2c3c900) 00010000:00010000:3.0:1788460505.047845:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460505.047872:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.047886:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.047899:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.048129:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.048140:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.048147:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.048445:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.048454:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.048461:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460505.049899:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788460505.049982:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378285802260ns, next at 379285798414ns, rc = 0 00010000:00010000:2.0:1788460505.050449:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050530:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050542:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050550:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050556:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050562:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050638:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460505.050661:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050667:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050674:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050680:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460505.050684:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050707:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050719:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed900) 00010000:00010000:2.0:1788460505.050722:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788460505.050727:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050733:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b7f4d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050754:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050760:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050765:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050770:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460505.050773:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050778:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050785:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460505.050788:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460505.050791:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.050805:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b7f3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460505.050816:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec67c1ca reply state 00000000a41fcd11 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460505.050824:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460505.050930:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+37:11618:x1875336462684288:12345-192.168.203.32@tcp:36:rm.0 Request processed in 3260us (3441us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788460505.050941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 198 00010000:00010000:3.0:1788460505.057357:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.057393:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.057401:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.057406:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460505.057411:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.057419:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.057435:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c52ed200) 00010000:00010000:3.0:1788460505.057438:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460505.057443:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.057457:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.061100:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460505.061114:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.061125:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460505.061130:0:7658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.061141:0:7658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.061162:0:7658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9650c52ed900) 00010000:00010000:1.0:1788460505.061166:0:7658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788460505.061171:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.061716:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b7f54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.061744:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460505.061765:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460505.061767:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460505.089812:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.090101:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462684544 00000100:00100000:0.0:1788460505.090111:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462684544 00000100:00100000:0.0:1788460505.090171:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 199 00000100:00100000:0.0:1788460505.090212:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+36:11624:x1875336462684544:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460505.090255:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460505.090275:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7f5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1588 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.090384:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.090397:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.090405:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.090419:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.090425:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.090431:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788460505.091251:0:7007:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788460505.091495:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091508:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091517:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091565:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091572:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091578:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091584:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.091588:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091594:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091606:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460505.091609:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460505.091613:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091618:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7f62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460505.091630:0:7007:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7bde755 reply state 00000000c210ad77 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460505.091637:0:7007:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788460505.091666:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7f5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 39 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091694:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 38 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.091701:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650d2c3c000) 00010000:00010000:0.0:1788460505.091703:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460505.091706:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5aa00, rc 0) 00000100:00100000:0.0:1788460505.091782:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+39:11624:x1875336462684544:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1601us (1979us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788460505.091791:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 199 00010000:00010000:1.0:1788460505.093466:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.093480:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.093486:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.093491:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460505.093496:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.093503:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.093773:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650d2c3cb00) 00010000:00010000:1.0:1788460505.093777:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460505.093782:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.093788:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b7f69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460505.095140:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.095391:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462684672 00000100:00100000:0.0:1788460505.095412:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462684672 00000100:00100000:0.0:1788460505.095475:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1788460505.095485:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462684672:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460505.095504:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460505.095523:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d158f expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460505.095554:0:8864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460505.095574:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788460505.095578:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460505.095587:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 6 pid: 8864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.095605:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 6 pid: 8864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.095636:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a600, rc 0) 00000100:00100000:0.0:1788460505.095683:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2379:x1875336462684672:12345-192.168.203.32@tcp:101:bash.0 Request processed in 200us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.095690:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00080000:1.0:1788460505.095762:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460505.098598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460505.098688:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462684800 00000100:00100000:2.0:1788460505.098708:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462684800 00000100:00100000:2.0:1788460505.098866:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:2.0:1788460505.098879:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fccf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:11624:x1875336462684800:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460505.098897:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460505.099091:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1596 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.099275:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 7 pid: 8864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.099989:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460505.099996:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460505.100004:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.100055:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 7 pid: 8864 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.100082:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 7 pid: 8864 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460505.100096:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1875336482599552:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460505.100809:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4567c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460505.108630:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6699:1875336482599552:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460505.108665:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.108685:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009200, rc 0) 00000100:00100000:2.0:1788460505.108742:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fccf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:11624:x1875336462684800:12345-192.168.203.32@tcp:101:bash.0 Request processed in 9866us (10460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460505.108752:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:0.0:1788460505.108916:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460505.109053:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462684928 00000100:00100000:2.0:1788460505.109060:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462684928 00010000:00010000:2.0:1788460505.109088:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 7 pid: 8864 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460505.109245:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:2.0:1788460505.109255:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462684928:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460505.109269:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460505.109289:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 7 pid: 8864 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.109320:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 7 pid: 8864 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.109353:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab069c6/0x889bb893541b7f7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d158f expref: 7 pid: 8864 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.109367:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460505.109371:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460505.109379:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.109389:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.109420:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460505.109434:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875336482599680:192.168.203.32@tcp:105: 00000100:00100000:2.0:1788460505.109504:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4567c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460505.115492:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.115632:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462685184 00000100:00100000:1.0:1788460505.115642:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462685184 00000100:00100000:1.0:1788460505.115702:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:1.0:1788460505.115727:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+38:11624:x1875336462685184:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:1.0:1788460505.116731:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+39:11624:x1875336462685184:12345-192.168.203.32@tcp:35:bash.0 Request processed in 1001us (1243us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788460505.116742:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1788460505.120828:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875336482599680:192.168.203.32@tcp:105: 00010000:00010000:2.0:1788460505.120856:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460505.120934:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2380:x1875336462684928:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 11679us (12016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460505.120945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 82 00000100:00100000:0.0:1788460505.240557:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.240657:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462685312 00000100:00100000:1.0:1788460505.240668:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462685312 00000100:00100000:1.0:1788460505.240731:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:1.0:1788460505.240746:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+39:11640:x1875336462685312:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460505.240770:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460505.240788:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d159d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.240908:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.240922:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.240934:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460505.240970:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788460505.240974:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460505.240990:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.241013:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b7f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d159d expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.241244:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d159d expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.241252:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:1.0:1788460505.241255:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460505.241258:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5000, rc 0) 00000100:00100000:1.0:1788460505.241308:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:11640:x1875336462685312:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 569us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460505.241315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 200 00000100:00100000:0.0:1788460505.245468:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.245602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462685568 00000100:00100000:3.0:1788460505.245611:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462685568 00000100:00100000:3.0:1788460505.245670:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 201 00000100:00100000:3.0:1788460505.245680:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+40:11640:x1875336462685568:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460505.245701:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460505.245721:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15a4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.245841:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.245855:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.245869:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460505.245879:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788460505.246144:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15a4 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.246163:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15a4 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.246173:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650d2c3c000) 00010000:00010000:3.0:1788460505.246176:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460505.246363:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c000, rc 0) 00000100:00100000:3.0:1788460505.246436:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+42:11640:x1875336462685568:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 757us (986us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788460505.246445:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 201 00000100:00100000:0.0:1788460505.254719:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.254886:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.254974:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462685824 00000100:00100000:3.0:1788460505.254984:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462685824 00000100:00100000:3.0:1788460505.255051:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:3.0:1788460505.255062:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+42:11640:x1875336462685824:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460505.255095:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460505.255133:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7faf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15ab expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.255258:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7fb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.255273:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.255283:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7fb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460505.255295:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788460505.255428:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7faf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ab expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.255448:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ab expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.255457:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650d2c3c000) 00010000:00010000:3.0:1788460505.255460:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788460505.255463:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c600, rc 0) 00000100:00100000:3.0:1788460505.255521:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:11640:x1875336462685824:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 461us (635us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788460505.255529:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 202 00000100:00100000:2.0:1788460505.256894:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462685952 00000100:00100000:2.0:1788460505.256906:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462685952 00000100:00100000:2.0:1788460505.257087:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1788460505.257097:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+44:2382:x1875336462685952:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460505.257112:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460505.257133:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b7fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15a4 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.257149:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650d2c3c000) 00010000:00010000:2.0:1788460505.257153:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460505.257224:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:2382:x1875336462685952:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 128us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460505.257231:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460505.272321:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.272706:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462686080 00000100:00100000:1.0:1788460505.272716:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462686080 00000100:00100000:1.0:1788460505.272839:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:1.0:1788460505.272851:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+6:2381:x1875336462686080:12345-192.168.203.32@tcp:1:lfs.0 00010000:00010000:1.0:1788460505.272896:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.272928:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.272938:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460505.272943:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460505.272947:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.272981:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.273009:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 6 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460505.273025:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8864:1875336482599808:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460505.273122:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460505.276206:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8864:1875336482599808:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460505.276254:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460505.277074:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.277497:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462686208 00000100:00100000:1.0:1788460505.277506:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462686208 00002000:00100000:1.0:1788460505.277554:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9650efcfdc00 x1875336462686208/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:661/0 lens 504/0 e 0 to 0 dl 1788460516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788460505.277564:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efcfdc00 with x1875336462686208 ext(0->8) 00010000:00010000:1.0:1788460505.277572:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 7 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.277588:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 7 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460505.277597:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650efcfdc00 00000100:00100000:1.0:1788460505.277629:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1788460505.277638:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462686208:12345-192.168.203.32@tcp:4:lfs.0 00000100:00100000:1.0:1788460505.278627:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2380:x1875336462686208:12345-192.168.203.32@tcp:4:lfs.0 Request processed in 984us (1552us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788460505.278637:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00002000:00100000:1.0:1788460505.278646:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9650efcfdc00 x1875336462686208/t4294967308(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:661/0 lens 504/448 e 0 to 0 dl 1788460516 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788460505.278669:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efcfdc00 with x1875336462686208 ext(0->8) 00010000:00010000:1.0:1788460505.278677:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 9 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.278693:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 9 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460505.278701:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9650efcfdc00 00000100:00100000:1.0:1788460505.284648:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.284745:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462686336 00000100:00100000:3.0:1788460505.284755:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462686336 00010000:00010000:3.0:1788460505.284792:0:7669:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 9 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460505.284856:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 83 00000100:00100000:3.0:1788460505.284866:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2382:x1875336462686336:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460505.284881:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788460505.284901:0:7669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788460505.284916:0:7669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788460504 00002000:00010000:3.0:1788460505.284918:0:7669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788460504 00002000:00010000:3.0:1788460505.284920:0:7669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788460504 00010000:00010000:3.0:1788460505.284926:0:7669:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 9 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.284939:0:7669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 9 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.284961:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008650ee5a/0x889bb893541b7f85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1596 expref: 9 pid: 6699 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.284978:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460505.284982:0:7669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460505.284988:0:7669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.284998:0:7669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.285158:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460505.286253:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2382:x1875336462686336:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1379us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460505.286264:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 83 00010000:00010000:0.0:1788460505.286296:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286308:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286334:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286354:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286360:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286367:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460505.286371:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286379:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286393:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.286400:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b7fc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460505.286452:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462686080:12345-192.168.203.32@tcp:1:lfs.0 Request processed in 13604us (14141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.286460:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:0.0:1788460505.289114:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.289221:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462686592 00000100:00100000:3.0:1788460505.289231:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462686592 00000100:00100000:3.0:1788460505.289283:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:3.0:1788460505.289294:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2869450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+43:11640:x1875336462686592:12345-192.168.203.32@tcp:35:lfs.0 00000004:00010000:3.0:1788460505.289358:0:12105:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7fb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ab expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460505.289626:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788460505.289671:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788460505.289985:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788460505.290048:0:12105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.290063:0:12105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 47 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.290072:0:12105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.290106:0:12105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 47 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.290121:0:12105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 47 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460505.290133:0:12105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12105:1875336482599936:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460505.290250:0:12105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460505.296866:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.296958:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462686720 00000100:00100000:0.0:1788460505.296967:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462686720 00010000:00010000:0.0:1788460505.297024:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 48 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460505.297081:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 84 00000100:00100000:0.0:1788460505.297093:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:2379:x1875336462686720:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460505.297109:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460505.297117:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 48 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.297132:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 48 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.297154:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650d2c3c000) 00010000:00010000:0.0:1788460505.297161:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.297171:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.297197:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.297227:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460505.297286:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+48:2379:x1875336462686720:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 195us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.297294:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 84 00010000:00010000:3.0:1788460505.297430:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b7f70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1588 expref: 47 pid: 7007 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460505.297455:0:12105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12105:1875336482599936:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460505.297479:0:12105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.297489:0:12105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.297496:0:12105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460505.297810:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788460505.298088:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788460505.298977:0:12105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482600064:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788460505.300580:0:12105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460505.300627:0:12105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460505.300759:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482600064 00000100:00100000:1.0:1788460505.300766:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482600064 00000100:00100000:1.0:1788460505.300826:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460505.300832:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12105:x1875336482600064:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788460505.300930:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12105:x1875336482600064:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460505.300937:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788460505.301015:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460505.301222:0:12105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482600064:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1788460505.301883:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788460505.302052:0:12105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482600192:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788460505.302099:0:12105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460505.302129:0:12105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460505.302571:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482600192 00000100:00100000:1.0:1788460505.302579:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482600192 00000100:00100000:1.0:1788460505.302642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460505.302651:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12105:x1875336482600192:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788460505.302822:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:12105:x1875336482600192:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 171us (722us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788460505.302831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460505.303086:0:12105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efd2b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12105:1875336482600192:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1788460505.303147:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788460505.303228:0:12105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.303239:0:12105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.303246:0:12105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.303252:0:12105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029da00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.303257:0:12105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.303264:0:12105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.303279:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650d2c3c000) 00010000:00010000:0.0:1788460505.303282:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788460505.303287:0:12105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.303293:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b7fcb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788460505.303759:0:12105:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788460505.303860:0:12105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788460505.303870:0:12105:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378539690419ns, next at 379539688638ns, rc = 0 00000001:00080000:1.0:1788460505.303876:0:12105:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788460505.303909:0:12105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650d2c3c000) 00010000:00010000:1.0:1788460505.303912:0:12105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788460505.303919:0:12105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b7fb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ab expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460505.304035:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2869450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:11640:x1875336462686592:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 14733us (14919us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788460505.304044:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000020:00080000:1.0:1788460505.304049:0:12105:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788460505.307600:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.307704:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462686848 00000100:00100000:3.0:1788460505.307713:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462686848 00000100:00100000:3.0:1788460505.307793:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 203 00000100:00100000:3.0:1788460505.307803:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+50:11640:x1875336462686848:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460505.307827:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460505.307849:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7fd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.308021:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b2 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.308061:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b2 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.308082:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460505.308085:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460505.308088:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c200, rc 0) 00000100:00100000:3.0:1788460505.308174:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:11640:x1875336462686848:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 372us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460505.308204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 203 00000100:00100000:0.0:1788460505.315325:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.315438:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462687104 00000100:00100000:1.0:1788460505.315447:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462687104 00000100:00100000:1.0:1788460505.315512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1788460505.315523:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+51:11640:x1875336462687104:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460505.315747:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11640:x1875336462687104:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 225us (431us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788460505.315756:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:1.0:1788460505.320294:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.320383:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462687232 00000100:00100000:3.0:1788460505.320392:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462687232 00000100:00100000:0.0:1788460505.320541:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 322 00000100:00100000:0.0:1788460505.320566:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462687232:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460505.320638:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462687232:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 74us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.320645:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 322 00000100:00100000:0.0:1788460505.321215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.321528:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462687360 00000100:00100000:3.0:1788460505.321535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462687360 00000100:00100000:0.0:1788460505.322907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:0.0:1788460505.322923:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462687360:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460505.323159:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2381:x1875336462687360:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 240us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.323168:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00080000:2.0:1788460505.323529:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460505.405994:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.406119:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462687488 00000100:00100000:0.0:1788460505.406132:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462687488 00000100:00100000:0.0:1788460505.406240:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:0.0:1788460505.406250:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11650:x1875336462687488:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:0.0:1788460505.406326:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406344:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406356:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406373:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406380:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406410:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406500:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406508:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406516:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460505.406555:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406568:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406573:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406581:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406587:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.406591:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406598:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406610:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:0.0:1788460505.406619:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460505.406624:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406630:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b7fd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406643:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406649:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406655:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406660:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.406663:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406668:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406675:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650d2c3c900) 00010000:00010000:0.0:1788460505.406678:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460505.406680:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406685:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b7fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406698:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406711:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406716:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406721:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.406723:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406729:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406737:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:0.0:1788460505.406739:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460505.406742:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.406749:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b7fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460505.406823:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11650:x1875336462687488:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 574us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.406832:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 204 00000100:00100000:2.0:1788460505.459465:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.459570:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462687744 00000100:00100000:3.0:1788460505.459580:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462687744 00000100:00100000:3.0:1788460505.459639:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 205 00000100:00100000:3.0:1788460505.459649:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+52:11653:x1875336462687744:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460505.459679:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460505.459707:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7fee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15b9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459790:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459804:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459815:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459842:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459850:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459856:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459979:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459987:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.459994:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460505.460002:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788460505.460105:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460113:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460118:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460124:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460505.460128:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460145:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460157:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460505.460160:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460505.460166:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460172:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b7ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460229:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460236:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460241:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460246:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029de00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460505.460248:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460253:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460260:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c52ed700) 00010000:00010000:3.0:1788460505.460263:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460505.460266:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460284:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b7ffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460324:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b7fee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460337:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.460344:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460505.460346:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460505.460349:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c600, rc 0) 00000100:00100000:3.0:1788460505.460411:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:11653:x1875336462687744:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 763us (955us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788460505.460419:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 205 00000100:00100000:1.0:1788460505.466970:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.467164:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462687872 00000100:00100000:0.0:1788460505.467174:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462687872 00000100:00100000:0.0:1788460505.471268:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:0.0:1788460505.471282:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:11653:x1875336462687872:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1788460505.471540:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471568:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471580:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471607:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471614:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471621:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471627:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460505.471631:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471640:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471650:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:0.0:1788460505.471654:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460505.471658:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.471664:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460505.471794:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:11653:x1875336462687872:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 513us (4896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.471808:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 206 00000100:00100000:2.0:1788460505.477037:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.477240:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462688128 00000100:00100000:1.0:1788460505.477250:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462688128 00000100:00100000:1.0:1788460505.477312:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:1.0:1788460505.477323:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+54:11653:x1875336462688128:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460505.479513:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11653:x1875336462688128:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 2181us (2487us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788460505.479527:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00010000:00010000:2.0:1788460505.484646:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460505.554474:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.554628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462688384 00000100:00100000:3.0:1788460505.554639:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462688384 00000100:00100000:3.0:1788460505.554702:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 207 00000100:00100000:3.0:1788460505.554713:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11663:x1875336462688384:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460505.554737:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460505.554740:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788460505.554765:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b7f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d159d expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.554784:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460505.554789:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460505.554812:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8018 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15c0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.554912:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.554925:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.554934:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.554965:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.554976:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 55 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460505.554990:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482600320:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460505.555392:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460505.562677:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875336482600320:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460505.562707:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460505.563669:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.564066:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462688512 00000100:00100000:1.0:1788460505.564076:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462688512 00010000:00010000:1.0:1788460505.564116:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 56 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460505.564161:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:1.0:1788460505.564541:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:2379:x1875336462688512:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460505.564805:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460505.564814:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 56 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.564829:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 56 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.564851:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b8003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b9 expref: 56 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.564867:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:1.0:1788460505.564871:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.564882:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.564890:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.566297:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460505.566465:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.566489:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460505.566530:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788460505.566682:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8018 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.566702:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.566709:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460505.566712:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788460505.566715:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029de00, rc 0) 00000100:00100000:1.0:1788460505.566747:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:2379:x1875336462688512:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 2210us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460505.566750:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+56:11663:x1875336462688384:12345-192.168.203.32@tcp:101:bash.0 Request processed in 12037us (12284us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788460505.566768:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 207 00000100:00100000:1.0:1788460505.566769:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 85 00000100:00100000:0.0:1788460505.570832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.573768:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462688768 00000100:00100000:3.0:1788460505.573783:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462688768 00000100:00100000:3.0:1788460505.576004:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 208 00000100:00100000:3.0:1788460505.576039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+55:11663:x1875336462688768:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:3.0:1788460505.576804:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.576823:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.576835:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460505.576890:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788460505.576941:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fffce617 reply state 00000000b77c9baa transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460505.576949:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460505.577063:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11663:x1875336462688768:12345-192.168.203.32@tcp:36:bash.0 Request processed in 1042us (6238us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788460505.577071:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 208 00000020:00080000:3.0:1788460505.577075:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788460505.585023:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.585117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462688896 00000100:00100000:0.0:1788460505.585127:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462688896 00000100:00100000:0.0:1788460505.585218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:0.0:1788460505.585229:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11663:x1875336462688896:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460505.585254:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460505.585274:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b8034 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.585383:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.585397:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.585403:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.585410:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.585426:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.585477:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.585491:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 59 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460505.585513:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482600448:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460505.585917:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194be40 going to sleep for 11 seconds 00010000:00010000:3.0:1788460505.588856:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.588873:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.588881:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.588887:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460505.588892:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.588900:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.588982:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460505.588986:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460505.588991:0:3303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.589067:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.589073:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b802d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460505.593807:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482600448:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460505.593892:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460505.599679:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.600423:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462689024 00000100:00100000:3.0:1788460505.600445:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462689024 00010000:00010000:3.0:1788460505.600486:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 59 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460505.600528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 86 00000100:00100000:3.0:1788460505.600538:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:2380:x1875336462689024:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460505.603018:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460505.603059:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 59 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.603077:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 59 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.603098:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b801f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c0 expref: 59 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.603116:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:1.0:1788460505.603122:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.603131:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.603139:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.603205:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460505.604716:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.604740:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460505.604808:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788460505.604813:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460505.604841:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460505.605692:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:2380:x1875336462689024:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 5151us (6018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460505.605703:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 86 00010000:00010000:3.0:1788460505.606488:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a400/0x889bb893541b8034 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.606511:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.606532:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460505.606535:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460505.606539:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5a600, rc 0) 00000100:00100000:3.0:1788460505.607782:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11663:x1875336462688896:12345-192.168.203.32@tcp:101:bash.0 Request processed in 22550us (22763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460505.607793:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 209 00000100:00100000:2.0:1788460505.611756:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.611858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462689280 00000100:00100000:3.0:1788460505.611869:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462689280 00000100:00100000:3.0:1788460505.611925:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:3.0:1788460505.611935:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+57:11663:x1875336462689280:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:0.0:1788460505.612774:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11663:x1875336462689280:12345-192.168.203.32@tcp:35:bash.0 Request processed in 836us (1022us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788460505.612785:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:2.0:1788460505.663887:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.664016:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462689408 00000100:00100000:1.0:1788460505.664033:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462689408 00000100:00100000:1.0:1788460505.664093:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:1.0:1788460505.664103:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+58:11669:x1875336462689408:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460505.664128:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460505.664146:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15ce expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.664518:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.664533:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.664543:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460505.664576:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788460505.664579:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460505.664594:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.664616:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ce expref: 60 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.664634:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ce expref: 59 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.664642:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:1.0:1788460505.664644:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460505.664660:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5a00, rc 0) 00000100:00100000:1.0:1788460505.664722:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11669:x1875336462689408:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 620us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460505.664729:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 210 00000100:00100000:2.0:1788460505.672003:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460505.672142:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462689536 00000100:00100000:1.0:1788460505.672154:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462689536 00000100:00100000:1.0:1788460505.672344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:1.0:1788460505.672355:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11669:x1875336462689536:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460505.672375:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460505.672394:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15d5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672463:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672489:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672504:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672511:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672517:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672602:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672624:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672631:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460505.672665:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788460505.672668:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460505.672684:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672695:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672704:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672711:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672717:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672722:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460505.672727:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672734:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672746:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:1.0:1788460505.672748:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460505.672758:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672765:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672778:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672784:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672789:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672794:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460505.672797:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672804:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672811:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c34d0300) 00010000:00010000:1.0:1788460505.672813:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460505.672816:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672821:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b805e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672858:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15d5 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672884:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15d5 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.672891:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:1.0:1788460505.672893:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460505.672896:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5800, rc 0) 00000100:00100000:1.0:1788460505.672962:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11669:x1875336462689536:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 610us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460505.672970:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 211 00000100:00100000:2.0:1788460505.676244:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460505.676720:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460505.676856:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462689664 00000100:00100000:3.0:1788460505.676866:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462689664 00000100:00100000:3.0:1788460505.676941:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460505.676953:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:2380:x1875336462689664:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460505.676967:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460505.676991:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15d5 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460505.677012:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460505.677016:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460505.677079:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:2380:x1875336462689664:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 129us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460505.677086:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1788460505.678284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462689920 00000100:00100000:1.0:1788460505.678295:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462689920 00000100:00100000:1.0:1788460505.678340:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:1.0:1788460505.678350:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11669:x1875336462689920:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460505.678369:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460505.678387:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b806c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15dc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.678514:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.678529:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.678537:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.678570:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.678591:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 60 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460505.678605:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482600576:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460505.678704:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14f2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460505.681289:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460505.681352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462690048 00000100:00100000:2.0:1788460505.681374:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462690048 00010000:00010000:2.0:1788460505.681412:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 61 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460505.681463:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 87 00000100:00100000:2.0:1788460505.681472:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:2379:x1875336462690048:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460505.681485:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460505.681491:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 61 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.681504:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 61 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.681524:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460505.681529:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.681539:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.681547:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.681565:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460505.681614:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:2379:x1875336462690048:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460505.681621:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 87 00010000:00010000:1.0:1788460505.682792:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a600/0x889bb893541b803b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15c7 expref: 60 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460505.682815:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482600576:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460505.682841:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.682850:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.682855:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460505.682875:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788460505.683138:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b806c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.683158:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460505.683166:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:1.0:1788460505.683206:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788460505.683210:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4400, rc 0) 00000100:00100000:1.0:1788460505.683260:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11669:x1875336462689920:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 4912us (6541us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788460505.683269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 212 00000100:00100000:3.0:1788460505.686101:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460505.686275:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462690304 00000100:00100000:2.0:1788460505.686284:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462690304 00000100:00100000:2.0:1788460505.686376:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1788460505.686386:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11669:x1875336462690304:12345-192.168.203.32@tcp:103:lfs.0 00010000:00010000:2.0:1788460505.686399:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460505.686420:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b7fd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15b2 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460505.686437:0:7669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460505.686441:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460505.686495:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11669:x1875336462690304:12345-192.168.203.32@tcp:103:lfs.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460505.686502:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1788460505.688004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.688090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462690432 00000100:00100000:0.0:1788460505.688098:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462690432 00000100:00100000:0.0:1788460505.688149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:0.0:1788460505.688157:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11669:x1875336462690432:12345-192.168.203.32@tcp:58:lfs.0 00010000:00010000:0.0:1788460505.688283:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.688300:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.688312:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460505.688506:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788460505.688585:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11669:x1875336462690432:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 427us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.688593:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 213 00000100:00100000:3.0:1788460505.690568:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460505.690701:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462690560 00000100:00100000:0.0:1788460505.690712:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462690560 00000100:00100000:0.0:1788460505.690769:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 214 00000100:00100000:0.0:1788460505.690779:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+59:11669:x1875336462690560:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460505.690816:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460505.690835:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15e3 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.690887:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.690896:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 60 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.690925:0:7007:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.690937:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 60 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.690950:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:0.0:1788460505.690953:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460505.690957:0:7007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 60 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460505.690965:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5b000, rc 0) 00000100:00100000:0.0:1788460505.691008:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11669:x1875336462690560:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 232us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460505.691015:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 214 00000040:00080000:1.0:1788460505.996528:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460505.996538:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460505.996574:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788460505.996581:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460505.996710:0:11722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482600704:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788460505.997434:0:11722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460505.999599:0:11722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482600704:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460506.007161:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460506.007723:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462690688 00000100:00100000:0.0:1788460506.007733:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462690688 00000100:00100000:0.0:1788460506.007812:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:0.0:1788460506.007839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11670:x1875336462690688:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788460506.007870:0:5844:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788460506.007988:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11670:x1875336462690688:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 153us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460506.007995:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 215 00000100:00100000:3.0:1788460506.010571:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00080000:2.0:1788460506.010693:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460506.010848:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462690816 00000100:00100000:0.0:1788460506.010859:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462690816 00000100:00100000:0.0:1788460506.010923:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:0.0:1788460506.010933:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11670:x1875336462690816:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788460506.011005:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011039:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011058:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011073:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011080:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011086:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011105:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011128:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011135:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460506.011171:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788460506.011175:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460506.011223:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011234:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011241:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011247:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011253:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460506.011257:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011264:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011276:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:0.0:1788460506.011279:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460506.011283:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011299:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5aa00/0x889bb893541b808f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011312:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011318:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011325:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011330:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460506.011333:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011339:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011347:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9650d2c3c900) 00010000:00010000:0.0:1788460506.011349:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460506.011352:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011359:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ac00/0x889bb893541b8096 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011372:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011377:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011389:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011394:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460506.011397:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011404:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011411:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:0.0:1788460506.011413:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460506.011416:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.011422:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b809d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460506.011686:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11670:x1875336462690816:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 752us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460506.011697:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 216 00000100:00100000:1.0:1788460506.025914:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.026057:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462691072 00000100:00100000:3.0:1788460506.026067:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462691072 00000100:00100000:3.0:1788460506.026125:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:3.0:1788460506.026135:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+60:11670:x1875336462691072:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460506.026158:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460506.026176:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b80a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15ea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026299:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026314:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026326:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460506.026336:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788460506.026439:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026457:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026465:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026490:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460506.026495:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026502:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026514:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460506.026517:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788460506.026523:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026529:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026569:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b80a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ea expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026579:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:3.0:1788460506.026581:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460506.026585:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b80a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ea expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.026595:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029cc00, rc 0) 00000100:00100000:3.0:1788460506.026660:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11670:x1875336462691072:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 526us (762us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788460506.026667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 217 00000100:00100000:1.0:1788460506.041314:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.041395:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462691200 00000100:00100000:3.0:1788460506.041427:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462691200 00000100:00100000:3.0:1788460506.041487:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:3.0:1788460506.041496:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11670:x1875336462691200:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460506.041532:0:5843:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460506.041632:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11670:x1875336462691200:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 137us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460506.041640:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 218 00000100:00100000:2.0:1788460506.049924:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.050295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462691456 00000100:00100000:3.0:1788460506.050305:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462691456 00000100:00100000:3.0:1788460506.050367:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:3.0:1788460506.050377:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11670:x1875336462691456:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460506.050408:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460506.050411:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788460506.050435:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ce expref: 61 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.050466:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460506.050471:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460506.050486:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b80b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15f1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460506.050872:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788460506.055531:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b80c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.055555:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b80c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.055568:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b80c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.055636:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b80b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f1 expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.055655:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b80c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f1 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.055664:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c3cb0f00) 00010000:00010000:2.0:1788460506.055680:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460506.055684:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009200, rc 0) 00000100:00100000:2.0:1788460506.055767:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11670:x1875336462691456:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 5390us (5851us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788460506.055776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 219 00000100:00100000:1.0:1788460506.059603:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.059676:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462691712 00000100:00100000:3.0:1788460506.059685:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462691712 00000100:00100000:3.0:1788460506.059736:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:3.0:1788460506.059745:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11670:x1875336462691712:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460506.059820:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460506.059847:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b80c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f1 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.059864:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c3cb0f00) 00010000:00010000:3.0:1788460506.059873:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460506.059893:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.059915:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.059926:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.059977:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.059985:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.059992:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060068:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060076:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060082:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060088:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460506.060097:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060106:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060115:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:3.0:1788460506.060118:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460506.060121:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060127:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b80ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060137:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060143:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060148:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060153:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029da00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460506.060157:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060163:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060170:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xeb702cb8 (ffff9650c52ed700) 00010000:00010000:3.0:1788460506.060172:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460506.060219:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.060225:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xeb702cb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.060297:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11670:x1875336462691712:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 552us (702us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460506.060304:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 220 00000100:00100000:1.0:1788460506.062747:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.062821:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462691840 00000100:00100000:3.0:1788460506.062830:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462691840 00000100:00100000:3.0:1788460506.062884:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:3.0:1788460506.062893:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+61:11670:x1875336462691840:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460506.062922:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460506.062941:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b80dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15f8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.062973:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.062987:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.062998:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.063107:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c000/0x889bb893541b80dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.063124:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.063138:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:3.0:1788460506.063141:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460506.063144:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c400, rc 0) 00000100:00100000:3.0:1788460506.063221:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11670:x1875336462691840:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 329us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460506.063229:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 221 00000100:00100000:2.0:1788460506.069707:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460506.069805:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462692096 00000100:00100000:0.0:1788460506.069814:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462692096 00000100:00100000:0.0:1788460506.069877:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 222 00000100:00100000:0.0:1788460506.069888:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+62:11670:x1875336462692096:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788460506.069978:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.069994:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.070018:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460506.070301:0:7007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788460506.070310:0:7007:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379306130601ns, next at 380306128383ns, rc = 0 00000004:00010000:0.0:1788460506.070389:0:7007:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021366420 reply state 0000000087a44a72 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460506.070399:0:7007:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460506.070484:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+64:11670:x1875336462692096:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 597us (787us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788460506.070493:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 222 00000100:00100000:1.0:1788460506.074591:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:2.0:1788460506.074762:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.074773:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.074780:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.074786:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460506.074791:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.074798:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.074814:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:2.0:1788460506.074817:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460506.074822:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.074828:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b200/0x889bb893541b80ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.075441:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462692224 00000100:00100000:3.0:1788460506.075453:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462692224 00000100:00100000:3.0:1788460506.075511:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:3.0:1788460506.075520:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+63:11670:x1875336462692224:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460506.075545:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460506.075563:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d15ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.075628:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.075642:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.075662:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:3.0:1788460506.075665:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460506.075667:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029da00, rc 0) 00000100:00100000:3.0:1788460506.075721:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+64:11670:x1875336462692224:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 202us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460506.075744:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 223 00000100:00100000:1.0:1788460506.091612:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460506.091698:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462692352 00000100:00100000:0.0:1788460506.091708:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462692352 00000100:00100000:0.0:1788460506.091785:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:0.0:1788460506.091796:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2382:x1875336462692352:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788460506.092115:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2382:x1875336462692352:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 320us (513us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788460506.092123:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00080000:2.0:1788460506.092249:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460506.108506:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.109062:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462692608 00000100:00100000:1.0:1788460506.109072:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462692608 00000100:00100000:1.0:1788460506.109133:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:1.0:1788460506.109143:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+64:11670:x1875336462692608:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788460506.109474:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+65:11670:x1875336462692608:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 331us (976us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788460506.109482:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:1.0:1788460506.117821:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460506.117942:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462692864 00000100:00100000:0.0:1788460506.117952:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462692864 00000100:00100000:0.0:1788460506.118004:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:0.0:1788460506.118015:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+65:11670:x1875336462692864:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788460506.118147:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+65:11670:x1875336462692864:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 134us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460506.118165:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 224 00000100:00100000:3.0:1788460506.121278:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.121375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462692992 00000100:00100000:1.0:1788460506.121385:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462692992 00000100:00100000:1.0:1788460506.121456:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:1.0:1788460506.121466:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+65:11670:x1875336462692992:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460506.121486:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460506.121505:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b80f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1606 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.121576:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b80ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.121590:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b80ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.121601:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b80ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460506.121634:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460506.121652:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b80ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.121676:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b80f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1606 expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.121694:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b80ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1606 expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.121702:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:1.0:1788460506.121705:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788460506.121709:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4000, rc 0) 00000100:00100000:1.0:1788460506.121793:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+66:11670:x1875336462692992:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 327us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460506.121800:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 225 00000100:00100000:2.0:1788460506.125392:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460506.125757:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462693120 00000100:00100000:0.0:1788460506.125767:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462693120 00000100:00100000:0.0:1788460506.125826:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1788460506.125836:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+10:2379:x1875336462693120:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460506.125872:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460506.125896:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d160d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460506.125922:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bdd9, blocks: 0x1 00010000:00010000:0.0:1788460506.125940:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1788460506.125944:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460506.125953:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.125972:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.125985:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5bc00, rc 0) 00000100:00100000:0.0:1788460506.126054:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:2379:x1875336462693120:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 220us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460506.126061:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:0.0:1788460506.137111:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460506.153443:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462693376 00000100:00100000:2.0:1788460506.153460:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462693376 00000100:00100000:2.0:1788460506.153534:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:2.0:1788460506.153544:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+66:11670:x1875336462693376:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788460506.153651:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+66:11670:x1875336462693376:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 108us (16550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460506.153659:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 226 00000100:00100000:3.0:1788460506.162260:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460506.162352:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462693504 00000100:00100000:2.0:1788460506.162362:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462693504 00000100:00100000:2.0:1788460506.162403:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:2.0:1788460506.162411:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:11670:x1875336462693504:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460506.162429:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460506.162455:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1614 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.162484:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 12 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.162494:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460506.162498:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460506.162503:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.162533:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 12 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.162566:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 12 pid: 6700 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460506.162579:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec034700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875336482600832:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460506.162668:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4567840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460506.165149:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.165262:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462693632 00000100:00100000:1.0:1788460506.165271:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462693632 00010000:00010000:1.0:1788460506.165313:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 13 pid: 6700 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.165350:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:1.0:1788460506.165359:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2379:x1875336462693632:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460506.165372:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460506.165394:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 13 pid: 6700 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.165407:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 13 pid: 6700 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.165429:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460506.165433:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460506.165441:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 13 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.165461:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 13 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.165497:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 13 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.165524:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1875336482600960:192.168.203.32@tcp:105: 00000100:00100000:1.0:1788460506.165600:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460506.167134:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5827:1875336482600960:192.168.203.32@tcp:105: 00010000:00010000:1.0:1788460506.167160:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460506.167240:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2379:x1875336462693632:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1882us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460506.167251:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00010000:00010000:2.0:1788460506.167874:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f33703c/0x889bb893541b8106 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d160d expref: 12 pid: 6700 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460506.167894:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec034700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875336482600832:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460506.167929:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.167942:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008600, rc 0) 00000100:00100000:2.0:1788460506.167982:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:11670:x1875336462693504:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 5572us (5731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460506.167990:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:0.0:1788460506.171597:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.171721:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462693760 00000100:00100000:3.0:1788460506.171731:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462693760 00002000:00100000:3.0:1788460506.171780:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9650f5b7df80 x1875336462693760/t0(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:662/0 lens 504/0 e 0 to 0 dl 1788460517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460506.171792:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650f5b7df80 with x1875336462693760 ext(0->12) 00002000:00010000:3.0:1788460506.171799:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650f5b7df80 00000100:00100000:3.0:1788460506.171831:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1788460506.171840:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+11:2380:x1875336462693760:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788460506.172358:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2380:x1875336462693760:12345-192.168.203.32@tcp:4:lhsmtool_posix.0 Request processed in 516us (769us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788460506.172367:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00002000:00100000:3.0:1788460506.172376:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9650f5b7df80 x1875336462693760/t4294967321(0) o4->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:662/0 lens 504/448 e 0 to 0 dl 1788460517 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460506.172384:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650f5b7df80 with x1875336462693760 ext(0->12) 00002000:00010000:3.0:1788460506.172388:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650f5b7df80 00000100:00100000:0.0:1788460506.178987:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.179234:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462693888 00000100:00100000:1.0:1788460506.179244:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462693888 00000100:00100000:1.0:1788460506.179304:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 227 00000100:00100000:1.0:1788460506.179314:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+66:11670:x1875336462693888:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788460506.274247:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+66:11670:x1875336462693888:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 94921us (95258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460506.274261:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 227 00000001:00080000:3.0:1788460506.274812:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1788460506.274819:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788460506.274851:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650d115ecc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788460506.274856:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650fdfa2200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650d115ea80 00000020:00080000:3.0:1788460506.274859:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650fdfa2400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9650fca05800 00000001:00080000:3.0:1788460506.274912:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788460506.274925:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788460506.274947:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650d194ba80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788460506.274951:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650efbf9f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650d194b180 00000020:00080000:3.0:1788460506.274954:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650efbf9900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9650fcd1c000 00000004:00080000:3.0:1788460506.274988:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788460506.275000:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1788460506.275129:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482601088:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788460506.275340:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460506.275494:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482601088 00000100:00100000:3.0:1788460506.275502:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482601088 00000100:00100000:3.0:1788460506.275666:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788460506.275676:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1875336482601088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788460506.275704:0:8864:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788460506.275737:0:8864:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a99bdd8, atime: 0x6a99bdd8, ctime: 0x6a99bdd8, blocks: 0x1 00010000:00010000:3.0:1788460506.275746:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.275760:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1788460506.275765:0:8864:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460506.275771:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.275787:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.275811:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.275819:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.275836:0:8864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460506.276375:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460506.276383:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.276392:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460506.276396:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.276501:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.276520:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.276527:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb91b8c0/0x889bb893541b8114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.276659:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460506.276661:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460506.276663:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788460506.276726:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788460506.276875:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788460506.277099:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482601344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788460506.277155:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460506.277342:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460506.277349:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482601216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788460506.277373:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460506.277512:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482601344 00000100:00100000:0.0:1788460506.277520:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482601344 00000100:00100000:0.0:1788460506.277636:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482601216 00000100:00100000:0.0:1788460506.277640:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482601216 00000100:00100000:0.0:1788460506.277654:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460506.277661:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482601344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788460506.277792:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788460506.277795:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788460505 00002000:00010000:0.0:1788460506.277798:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788460506.277800:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788460505 -> 1788460505 00002000:00010000:0.0:1788460506.277802:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788460506.277843:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3319:x1875336482601344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (688us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788460506.277850:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460506.277865:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788460506.277871:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482601216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788460506.277883:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788460506.277898:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.277917:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.277925:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788460506.277940:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460506.277945:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.277974:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.277990:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 12 pid: 6701 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460506.278003:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875336482601472:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460506.278075:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c9180 going to sleep for 11 seconds 00000004:00080000:0.0:1788460506.278145:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650f5b7d180/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788460506.278151:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482601344:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788460506.278292:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460506.281232:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.281361:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788460506.281371:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788460506.281841:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462694016 00000100:00100000:3.0:1788460506.281851:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462694016 00000100:00100000:0.0:1788460506.282017:0:12613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:0.0:1788460506.282038:0:12613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2380:x1875336462694016:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788460506.282918:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3317:x1875336482601088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7238us (7573us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788460506.282929:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788460506.282980:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650fcd7a300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788460506.282986:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482601088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788460506.292249:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1875336482601472:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460506.292287:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.294209:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.294334:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462694144 00000100:00100000:1.0:1788460506.294344:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462694144 00010000:00010000:1.0:1788460506.294383:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 14 pid: 6701 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.294437:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:1.0:1788460506.294449:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+14:2379:x1875336462694144:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460506.294463:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460506.294469:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 14 pid: 6701 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294483:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 14 pid: 6701 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294508:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053fd3a60/0x889bb893541b7ed6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1573 expref: 14 pid: 6701 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294525:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460506.294529:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460506.294535:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294556:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294598:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460506.294646:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+13:2379:x1875336462694144:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 199us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460506.294654:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00010000:00010000:1.0:1788460506.294680:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294690:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294700:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294707:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.294723:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788460506.295283:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3319:x1875336482601216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17409us (17906us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788460506.295292:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1788460506.295314:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460506.295320:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.295329:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460506.295339:0:7659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.295350:0:7659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.295363:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.295370:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eab069c6/0x889bb893541b811b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.295387:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460506.295389:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460506.295391:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788460506.295427:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650f5b7f480/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788460506.295434:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482601216:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788460506.372047:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788460506.372062:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1788460506.372074:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1788460506.372226:0:12613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462694016:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 90184us (90997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460506.372236:0:12613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1788460506.375842:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.376065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462694400 00000100:00100000:1.0:1788460506.376077:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462694400 00000100:00100000:1.0:1788460506.376139:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:1.0:1788460506.376151:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:11670:x1875336462694400:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460506.376241:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460506.376269:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b80ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1606 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.376291:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:1.0:1788460506.376297:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460506.376346:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.376359:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.376368:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460506.376689:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051379019 reply state 0000000015b5356c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.376699:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460506.376860:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:11670:x1875336462694400:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 710us (1027us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788460506.376868:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 228 00000100:00100000:3.0:1788460506.385171:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:0.0:1788460506.387519:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.387536:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.387544:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.387550:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460506.387569:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.387577:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.387592:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:0.0:1788460506.387596:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460506.387601:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460506.387608:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8122 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460506.388460:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462694528 00000100:00100000:2.0:1788460506.388473:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462694528 00000100:00100000:3.0:1788460506.388651:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:3.0:1788460506.388663:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462694528:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788460506.388879:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788460506.388884:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788460505 -> 1788460504 00002000:00010000:3.0:1788460506.388886:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788460504 00002000:00010000:3.0:1788460506.388888:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788460505 -> 1788460504 00002000:00010000:3.0:1788460506.388890:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788460506.389036:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462694528:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 375us (3875us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788460506.389046:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 71 00000100:00100000:0.0:1788460506.392444:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460506.392548:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462694784 00000100:00100000:2.0:1788460506.392558:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462694784 00000100:00100000:3.0:1788460506.392733:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:3.0:1788460506.392767:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:11670:x1875336462694784:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788460506.392833:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.392850:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.392859:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.392894:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.392907:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 20 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.392921:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd79880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482601600:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460506.393031:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460506.396402:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd79880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875336482601600:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460506.396442:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460506.397397:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.397768:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462694912 00000100:00100000:3.0:1788460506.397777:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462694912 00010000:00010000:3.0:1788460506.397813:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.397854:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:3.0:1788460506.397879:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:2379:x1875336462694912:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460506.397904:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460506.397912:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.397923:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.397945:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b80e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15f8 expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.397960:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:3.0:1788460506.397965:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.397973:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.397980:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.398017:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460506.398114:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398125:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398154:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398161:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398168:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398201:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460506.398215:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398224:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398233:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:2.0:1788460506.398236:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788460506.398240:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.398246:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8129 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.398368:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:2379:x1875336462694912:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 489us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460506.398376:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:2.0:1788460506.401485:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:11670:x1875336462694784:12345-192.168.203.32@tcp:55:lhsmtool_posix.0 Request processed in 8709us (9039us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788460506.401521:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 229 00000100:00100000:0.0:1788460506.405375:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.405522:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462695040 00000100:00100000:1.0:1788460506.405534:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462695040 00000100:00100000:1.0:1788460506.405601:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:1.0:1788460506.405613:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2380:x1875336462695040:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788460506.405660:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.405681:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.405690:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460506.405695:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460506.405699:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.405755:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.405769:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 8 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.405784:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875336482601728:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460506.405919:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5856a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460506.415446:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460506.415600:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462695168 00000100:00100000:2.0:1788460506.415610:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462695168 00010000:00010000:2.0:1788460506.415654:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 9 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460506.415766:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:2.0:1788460506.415778:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2380:x1875336462695168:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460506.415844:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460506.415866:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 9 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.415880:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 9 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.415914:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460506.415920:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460506.415926:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.415938:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.415958:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460506.416010:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+9:2380:x1875336462695168:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 236us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460506.416042:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 91 00010000:00010000:1.0:1788460506.416217:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d77a134d/0x889bb893541b810d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1614 expref: 8 pid: 6699 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.416233:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6699:1875336482601728:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460506.416259:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416269:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416277:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416300:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416319:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416328:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416335:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460506.416339:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416348:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416360:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.416368:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d98dcb9/0x889bb893541b8130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.416422:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462695040:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 10802us (11045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460506.416429:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 72 00000100:00100000:3.0:1788460506.419083:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.419144:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462695424 00000100:00100000:1.0:1788460506.419153:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462695424 00000100:00100000:1.0:1788460506.419305:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 230 00000100:00100000:1.0:1788460506.419325:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:11670:x1875336462695424:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788460506.419402:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.419580:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.419594:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.419784:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.419795:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.419803:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.419833:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.419845:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 20 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.419858:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482601856:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460506.419923:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5856a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460506.423156:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482601856:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460506.423230:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.425303:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.428032:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462695552 00000100:00100000:1.0:1788460506.428052:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462695552 00010000:00010000:1.0:1788460506.428105:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.428172:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:1.0:1788460506.428227:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:2379:x1875336462695552:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460506.428244:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460506.428263:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.428277:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.428300:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b80f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15ff expref: 21 pid: 5842 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.428319:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:1.0:1788460506.428325:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.428334:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.428342:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.429367:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460506.429642:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:2379:x1875336462695552:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 1457us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460506.429659:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00010000:00010000:2.0:1788460506.431606:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.431623:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460506.431822:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788460506.431976:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788460506.432036:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788460506.432122:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec034700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482601984:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788460506.435728:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460506.435815:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4567c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460506.441012:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482601984 00000100:00100000:1.0:1788460506.441036:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482601984 00000100:00100000:1.0:1788460506.441111:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460506.441122:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875336482601984:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788460506.441710:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875336482601984:12345-0@lo:1000:mdt00_001.0 Request processed in 588us (5986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460506.441720:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460506.441810:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788460506.441816:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788460506.441843:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650f5b7d180, transno 4294967322 00000100:00100000:2.0:1788460506.441865:0:5843:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9650f5b7f480 x1875336482601216/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788460522 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460506.441878:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec034700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482601984:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788460506.442896:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788460506.442970:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec034700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482602112:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788460506.443035:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460506.443061:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460506.443276:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482602112 00000100:00100000:1.0:1788460506.443283:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482602112 00000100:00100000:1.0:1788460506.443320:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460506.443329:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875336482602112:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788460506.443515:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1875336482602112:12345-0@lo:1000:mdt00_001.0 Request processed in 186us (493us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788460506.443522:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460506.443785:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec034700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875336482602112:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788460506.443817:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443841:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443848:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443854:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460506.443859:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443867:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443882:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:2.0:1788460506.443885:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460506.443890:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443896:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b813e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443927:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443933:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443939:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443943:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460506.443955:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443960:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443969:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460506.443971:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460506.443977:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 23 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443987:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 23 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.443995:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 23 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.444032:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 23 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460506.444045:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482602240:192.168.203.32@tcp:105: 00000100:00100000:2.0:1788460506.444105:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460506.453705:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875336482602240:192.168.203.32@tcp:105: 00010000:00010000:2.0:1788460506.453735:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.453746:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b600/0x889bb893541b8081 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457426:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457467:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457479:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457492:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457498:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457505:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457512:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460506.457516:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457524:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457535:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460506.457538:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460506.457542:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457549:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b8145 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457565:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457581:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457588:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457592:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460506.457595:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457601:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457609:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460506.457611:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460506.457614:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460506.457619:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b8137 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460506.457926:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:11670:x1875336462695424:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 38597us (38848us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788460506.457937:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 230 00000020:00080000:3.0:1788460506.457943:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788460506.458123:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.458442:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462695680 00000100:00100000:3.0:1788460506.458451:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462695680 00000040:00080000:1.0:1788460506.458671:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460506.458676:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788460506.459331:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:3.0:1788460506.459358:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:11669:x1875336462695680:12345-192.168.203.32@tcp:49:lfs.0 00000100:00100000:3.0:1788460506.459495:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:11669:x1875336462695680:12345-192.168.203.32@tcp:49:lfs.0 Request processed in 153us (1372us total) trans 0 rc 0/0 00000040:00080000:1.0:1788460506.459734:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788460506.459743:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460506.465806:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:0.0:1788460506.466258:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.466606:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462695936 00000100:00100000:1.0:1788460506.466617:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462695936 00000100:00100000:1.0:1788460506.466675:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:1.0:1788460506.466686:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2869850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+23:11670:x1875336462695936:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788460506.467738:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788460506.467847:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788460506.468462:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.468500:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462696192 00000100:00100000:3.0:1788460506.468508:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462696192 00000100:00100000:3.0:1788460506.468548:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 231 00000100:00100000:3.0:1788460506.468557:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11669:x1875336462696192:12345-192.168.203.32@tcp:58:lfs.0 00000040:00080000:3.0:1788460506.468743:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788460506.468818:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11669:x1875336462696192:12345-192.168.203.32@tcp:58:lfs.0 Request processed in 262us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460506.468826:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 231 00010000:00010000:1.0:1788460506.469499:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.469518:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.469529:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.469539:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.469545:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.469551:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.469565:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788460506.469634:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2869850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+25:11670:x1875336462695936:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 2950us (3376us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788460506.469643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000020:00080000:1.0:1788460506.469647:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788460506.469775:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460506.469783:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.469791:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460506.469794:0:7658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.469802:0:7658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.469814:0:7658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9650c34d0300) 00010000:00010000:2.0:1788460506.469817:0:7658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788460506.469822:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.469828:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b814c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.469847:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460506.469849:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460506.469851:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460506.508375:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460506.523759:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460506.523867:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462696320 00000100:00100000:2.0:1788460506.523876:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462696320 00000100:00100000:2.0:1788460506.523937:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 232 00000100:00100000:2.0:1788460506.523946:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+25:11672:x1875336462696320:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460506.523969:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460506.523986:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8153 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d161b expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524068:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524083:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524094:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524107:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524115:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524121:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524598:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524611:0:7007:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524619:0:7007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524650:0:7007:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.524674:0:7007:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 26 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460506.524688:0:7007:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482602368:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460506.524815:0:7007:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460506.532841:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460506.533085:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462696576 00000100:00100000:3.0:1788460506.533096:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462696576 00000100:00100000:3.0:1788460506.533154:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:3.0:1788460506.533211:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+27:5618:x1875336462696576:12345-192.168.203.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788460506.533675:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:5618:x1875336462696576:12345-192.168.203.32@tcp:35:ldlm_bl.0 Request processed in 497us (842us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788460506.533684:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 63 00000100:00100000:0.0:1788460506.535797:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460506.535889:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462696704 00000100:00100000:1.0:1788460506.535911:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462696704 00010000:00010000:1.0:1788460506.535951:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 28 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460506.535992:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:1.0:1788460506.536001:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:2379:x1875336462696704:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460506.536014:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460506.536043:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 28 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.536056:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 28 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.536078:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:1.0:1788460506.536082:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.536093:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.536101:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460506.536120:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460506.536574:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:2379:x1875336462696704:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 571us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460506.536584:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00010000:00010000:2.0:1788460506.539661:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8073 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15dc expref: 27 pid: 5843 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460506.539690:0:7007:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec036a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7007:1875336482602368:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460506.539715:0:7007:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539725:0:7007:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539732:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460506.539777:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788460506.539782:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460506.539799:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539814:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539823:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539849:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539856:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539862:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460506.539866:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539873:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.539887:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460506.539890:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460506.540375:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540386:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009e00/0x889bb893541b815a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540398:0:7007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540404:0:7007:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540409:0:7007:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540414:0:7007:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460506.540425:0:7007:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540432:0:7007:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540441:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9650c3cb0600) 00010000:00010000:2.0:1788460506.540453:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460506.540457:0:7007:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540462:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540501:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8153 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d161b expref: 27 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540513:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d161b expref: 26 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460506.540520:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460506.540523:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460506.540525:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460506.540582:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11672:x1875336462696320:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 16637us (16834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460506.540591:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 232 00000040:00080000:0.0:1788460507.435514:0:12652:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460507.435523:0:12652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460507.435580:0:12652:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788460507.435587:0:12652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788460507.471160:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460507.471169:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460507.471232:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788460507.471238:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460507.471513:0:11722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482602496:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788460507.471603:0:11722:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f611b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460507.487075:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460507.487244:0:11722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11722:1875336482602496:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460507.488754:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462696832 00000100:00100000:3.0:1788460507.488765:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462696832 00000100:00100000:3.0:1788460507.488816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00100000:3.0:1788460507.488825:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11684:x1875336462696832:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460507.488856:0:5842:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460507.488960:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11684:x1875336462696832:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 136us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.488967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 233 00000100:00100000:0.0:1788460507.497009:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460507.497101:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462697088 00000100:00100000:3.0:1788460507.497111:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462697088 00000100:00100000:3.0:1788460507.497168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:3.0:1788460507.497198:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+26:11684:x1875336462697088:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460507.497223:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460507.497244:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b816f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1622 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460507.497343:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460507.497358:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460507.497372:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460507.497382:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788460507.497516:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c400/0x889bb893541b816f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1622 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460507.497531:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1622 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460507.497539:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460507.497542:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460507.497551:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d000, rc 0) 00000100:00100000:3.0:1788460507.497616:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:11684:x1875336462697088:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 440us (618us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788460507.497623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 234 00000100:00100000:1.0:1788460507.514624:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460507.514689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460507.515718:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462697472 00000100:00100000:2.0:1788460507.515728:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462697472 00000100:00100000:2.0:1788460507.515928:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 235 00000100:00100000:2.0:1788460507.515940:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:11684:x1875336462697472:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788460507.516031:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516049:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516060:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516262:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516270:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516277:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516284:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460507.516288:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516296:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516308:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460507.516311:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460507.516315:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460507.516321:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b8184 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460507.516805:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:11684:x1875336462697472:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 864us (2112us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788460507.516814:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 235 00000040:00080000:0.0:1788460507.517678:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460507.517684:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460507.518198:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788460507.518206:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460507.522573:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462697216 00000100:00100000:3.0:1788460507.522588:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462697216 00000100:00100000:3.0:1788460507.522659:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1788460507.522670:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:2381:x1875336462697216:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460507.522684:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460507.522707:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1622 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460507.522727:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460507.522731:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460507.522785:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:2381:x1875336462697216:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 118us (8170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.522793:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1788460507.522863:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460507.522965:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462697728 00000100:00100000:3.0:1788460507.522969:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462697728 00000100:00100000:3.0:1788460507.522997:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 64 00000100:00100000:3.0:1788460507.523003:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+28:11684:x1875336462697728:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788460507.523288:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:11684:x1875336462697728:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 284us (425us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788460507.523296:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 64 00010000:00010000:2.0:1788460507.532309:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460507.661024:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482602624:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661091:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460507.661129:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482603136:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661150:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460507.661170:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788460507.661175:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482602752:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661216:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460507.661229:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482603264:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661245:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460507.661268:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482602880:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661288:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460507.661306:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460507.661311:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482603008:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661328:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460507.661355:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482602624 00000100:00100000:3.0:1788460507.661361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482602624 00000100:00100000:3.0:1788460507.661397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788460507.661403:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482602624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661443:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482602624:12345-0@lo:400:kworker.0 Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.661450:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788460507.661479:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603136 00000100:00100000:3.0:1788460507.661481:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603136 00000100:00100000:3.0:1788460507.661507:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482602752 00000100:00100000:3.0:1788460507.661509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482602752 00000100:00100000:3.0:1788460507.661518:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482602880 00000100:00100000:3.0:1788460507.661519:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482602880 00000100:00100000:3.0:1788460507.661531:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788460507.661554:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482603136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661581:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482603136:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.661587:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788460507.661598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788460507.661603:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482602752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661621:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482602752:12345-0@lo:400:kworker.0 Request processed in 19us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.661626:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788460507.661634:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788460507.661639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482602880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661661:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482602880:12345-0@lo:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.661666:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788460507.661696:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603264 00000100:00100000:3.0:1788460507.661699:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603264 00000100:00100000:3.0:1788460507.661718:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603008 00000100:00100000:3.0:1788460507.661721:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603008 00000100:00100000:3.0:1788460507.661736:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788460507.661741:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482603264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661765:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482603264:12345-0@lo:400:kworker.0 Request processed in 24us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.661770:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788460507.661778:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788460507.661783:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3318:x1875336482603008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661801:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3318:x1875336482603008:12345-0@lo:400:kworker.0 Request processed in 18us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460507.661815:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788460507.661852:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482603008:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661861:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482602880:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661888:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482602752:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661896:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482603264:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661902:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482602624:0@lo:400:kworker.0 00000100:00100000:3.0:1788460507.661908:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482603136:0@lo:400:kworker.0 00000100:00100000:0.0:1788460507.665845:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482603392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460507.666064:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788460507.666646:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460507.666653:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460507.668163:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460507.668193:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482603520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460507.668256:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460507.668317:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603392 00000100:00100000:0.0:1788460507.668325:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603392 00000100:00100000:0.0:1788460507.668363:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603520 00000100:00100000:0.0:1788460507.668366:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603520 00000100:00100000:0.0:1788460507.668380:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460507.668387:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f58bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3318:x1875336482603392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460507.668420:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460507.668467:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f58bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3318:x1875336482603392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460507.668473:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460507.668649:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788460507.668656:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482603520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460507.668666:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788460507.668691:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482603520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460507.668698:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788460507.668740:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482603520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460507.668756:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482603392:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788460507.705454:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788460507.705468:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788460507.705481:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1788460508.558922:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460509.295701:0:12705:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460509.295709:0:12705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460509.295749:0:12705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788460509.295754:0:12705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460509.503862:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460509.504027:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462697984 00000100:00100000:3.0:1788460509.504088:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462697984 00000100:00100000:3.0:1788460509.504273:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00100000:3.0:1788460509.504284:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+29:11705:x1875336462697984:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460509.504308:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460509.504326:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b818b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1629 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460509.504420:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b8192 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460509.504446:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b8192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460509.504460:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b8192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460509.504471:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788460509.504593:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b818b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1629 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460509.504628:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b8192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1629 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460509.504636:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:3.0:1788460509.504639:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788460509.504642:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460509.504693:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:11705:x1875336462697984:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 411us (840us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788460509.504701:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 236 00000100:00080000:1.0:1788460509.504807:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460509.511135:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460509.512939:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462698112 00000100:00100000:2.0:1788460509.512952:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462698112 00000100:00100000:2.0:1788460509.513026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 237 00000100:00100000:2.0:1788460509.513037:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:11705:x1875336462698112:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:2.0:1788460509.513104:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513120:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513131:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513156:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513162:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513169:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513217:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460509.513222:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513241:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513253:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460509.513256:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460509.513260:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460509.513266:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008a00/0x889bb893541b81a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460509.513472:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:11705:x1875336462698112:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 435us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460509.513481:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 237 00010000:00010000:2.0:1788460509.580578:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460509.614600:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460509.614806:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462698240 00000100:00100000:1.0:1788460509.614817:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462698240 00000100:00100000:1.0:1788460509.614912:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:1.0:1788460509.614925:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2382:x1875336462698240:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:1.0:1788460509.614943:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460509.614965:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a932fca5/0x889bb893541b81a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1630 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460509.614990:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a99bdd8, atime: 0x6a99bdd8, ctime: 0x6a99bdd8, blocks: 0xb 00010000:00010000:1.0:1788460509.615019:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1788460509.615024:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460509.615034:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a932fca5/0x889bb893541b81a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1630 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460509.615052:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a932fca5/0x889bb893541b81a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1630 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460509.615076:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5600, rc 0) 00000100:00100000:1.0:1788460509.615140:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2382:x1875336462698240:12345-192.168.203.32@tcp:101:cat.0 Request processed in 218us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460509.615161:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00080000:2.0:1788460509.616221:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460509.621290:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460509.621387:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462698368 00000100:00100000:2.0:1788460509.621397:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462698368 00002000:00100000:2.0:1788460509.621510:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9650efc46300 x1875336462698368/t0(0) o3->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:665/0 lens 488/0 e 0 to 0 dl 1788460520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460509.621522:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efc46300 with x1875336462698368 ext(0->4095) 00002000:00010000:2.0:1788460509.621529:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650efc46300 00000100:00100000:2.0:1788460509.621560:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460509.621570:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462698368:12345-192.168.203.32@tcp:3:cat.0 00000100:00100000:2.0:1788460509.621974:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2381:x1875336462698368:12345-192.168.203.32@tcp:3:cat.0 Request processed in 404us (693us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788460509.621982:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00002000:00100000:2.0:1788460509.621989:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9650efc46300 x1875336462698368/t0(0) o3->9e69358b-6b5d-4a87-b6fb-534c610a3920@192.168.203.32@tcp:665/0 lens 488/4536 e 0 to 0 dl 1788460520 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460509.622005:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9650efc46300 with x1875336462698368 ext(0->4095) 00002000:00010000:2.0:1788460509.622009:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9650efc46300 00000100:00100000:3.0:1788460510.443242:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460510.443277:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460510.443306:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460510.443329:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460510.443350:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460510.443380:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462698752 00000100:00100000:3.0:1788460510.443389:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462698752 00000100:00100000:3.0:1788460510.443458:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462698880 00000100:00100000:3.0:1788460510.443461:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462698880 00000100:00100000:3.0:1788460510.443486:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:3.0:1788460510.443494:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462698752:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460510.443563:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2382:x1875336462698752:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 69us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460510.443571:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:3.0:1788460510.443598:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:3.0:1788460510.443605:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2382:x1875336462698880:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460510.443632:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+8:2382:x1875336462698880:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460510.443638:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:1.0:1788460510.444205:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462698496 00000100:00100000:1.0:1788460510.444212:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462698496 00000100:00100000:1.0:1788460510.450793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 324 00000100:00100000:1.0:1788460510.450815:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462698496:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460510.450968:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2382:x1875336462698496:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 162us (7734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460510.450977:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 324 00000100:00100000:3.0:1788460510.451206:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462699008 00000100:00100000:3.0:1788460510.451940:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462699008 00000100:00100000:3.0:1788460510.452044:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462698624 00000100:00100000:3.0:1788460510.452049:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462698624 00000100:00080000:2.0:1788460510.452141:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460510.452146:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460510.455871:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:1.0:1788460510.455896:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462699008:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460510.456002:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2382:x1875336462699008:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 106us (12684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460510.456011:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 153 00000100:00100000:1.0:1788460510.456149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 154 00000100:00100000:1.0:1788460510.456225:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:2382:x1875336462698624:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460510.456273:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+31:2382:x1875336462698624:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 116us (12943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460510.456281:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 154 00010000:00010000:2.0:1788460510.604531:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788460511.328169:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:0.0:1788460511.328220:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1788460511.328239:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1788460511.328247:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650c4567900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788460511.328252:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e89b6f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650c4567c00 00000020:00080000:0.0:1788460511.328255:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650e89b6e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9650efb54000 00000001:00080000:0.0:1788460511.328270:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788460511.328296:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788460511.328506:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788460511.628398:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788460511.815729:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1788460511.815757:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1788460512.654867:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460512.656195:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460512.656203:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460512.656245:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788460512.656251:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460512.782347:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482603648:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.782415:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460512.782462:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482604160:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.782485:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460512.782505:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788460512.782510:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482603776:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.782526:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460512.782539:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482604288:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.782557:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460512.782579:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482603904:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.782601:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460512.782615:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460512.782620:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482604032:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.782640:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460512.782665:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603648 00000100:00100000:0.0:1788460512.782671:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603648 00000100:00100000:0.0:1788460512.782709:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788460512.782718:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482603648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.782768:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3316:x1875336482603648:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460512.782787:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788460512.782791:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482604416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460512.782817:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460512.782818:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604160 00000100:00100000:0.0:1788460512.782821:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604160 00000100:00100000:2.0:1788460512.782860:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604416 00000100:00100000:2.0:1788460512.782864:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604416 00000100:00100000:2.0:1788460512.782892:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788460512.782899:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482604416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460512.782926:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460512.782966:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482604416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460512.782972:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788460512.782995:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482604544:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788460512.783006:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460512.783010:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460512.783019:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603904 00000100:00100000:3.0:1788460512.783021:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460512.783022:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603904 00000100:00100000:3.0:1788460512.783054:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788460512.783065:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482604160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460512.783098:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482604160:12345-0@lo:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460512.783173:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604544 00000100:00100000:1.0:1788460512.783200:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604544 00000100:00100000:1.0:1788460512.783227:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788460512.783234:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482604544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460512.783251:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460512.783290:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482604544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460512.783295:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788460512.783430:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788460512.783437:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482603904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460512.783468:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482603904:12345-0@lo:400:kworker.0 Request processed in 32us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460512.783474:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1788460512.783491:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460512.783493:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460512.783513:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788460512.783518:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650f5b7f480, transno 4294967323 00000004:00080000:2.0:1788460512.783527:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788460512.783550:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482604416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460512.783564:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482603904:0@lo:400:kworker.0 00000100:00100000:1.0:1788460512.783570:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788460512.783573:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650fcd16a00, transno 4294967307 00000004:00080000:1.0:1788460512.783582:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788460512.783594:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650fcd7a300, transno 4294967310 00000100:00100000:1.0:1788460512.783602:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482604544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460512.783683:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482603776 00000100:00100000:0.0:1788460512.783688:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482603776 00000100:00100000:0.0:1788460512.783715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788460512.783721:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482603776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.783753:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482603776:12345-0@lo:400:kworker.0 Request processed in 33us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460512.783759:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788460512.783778:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604288 00000100:00100000:0.0:1788460512.783781:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604288 00000100:00100000:0.0:1788460512.783800:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604032 00000100:00100000:0.0:1788460512.783803:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604032 00000100:00100000:0.0:1788460512.783818:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460512.783823:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482604288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460512.783833:0:12613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788460512.783840:0:12613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482604032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.783857:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482604288:12345-0@lo:400:kworker.0 Request processed in 28us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460512.783863:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460512.783891:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482603776:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.783901:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482604288:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.783909:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482603648:0@lo:400:kworker.0 00000100:00100000:0.0:1788460512.783918:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482604160:0@lo:400:kworker.0 00000100:00100000:2.0:1788460512.784123:0:12613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d0261f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482604032:12345-0@lo:400:kworker.0 Request processed in 282us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460512.784129:0:12613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460512.785251:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482604032:0@lo:400:kworker.0 00000100:00100000:3.0:1788460512.786198:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:2.0:1788460513.676341:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460514.110171:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460514.118023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462699136 00000100:00100000:2.0:1788460514.118038:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462699136 00000100:00080000:0.0:1788460514.118198:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460514.118273:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00100000:2.0:1788460514.118283:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11349:x1875336462699136:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788460514.118387:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11349:x1875336462699136:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 Request processed in 106us (8227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460514.118407:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 238 00000100:00100000:0.0:1788460514.126450:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460514.126601:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462699392 00000100:00100000:3.0:1788460514.126611:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462699392 00000100:00100000:3.0:1788460514.126671:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:3.0:1788460514.126680:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:11349:x1875336462699392:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788460514.127011:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:11349:x1875336462699392:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 331us (571us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788460514.127019:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 65 00000100:00100000:3.0:1788460514.504700:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460514.504809:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462699520 00000100:00100000:2.0:1788460514.504820:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462699520 00000100:00100000:2.0:1788460514.504901:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00100000:2.0:1788460514.504911:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+5:12156:x1875336462699520:12345-192.168.203.32@tcp:101:lsof.0 00010000:00010000:2.0:1788460514.504929:0:7007:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460514.504948:0:7007:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b81ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1637 expref: -99 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460514.505020:0:7007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b81b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460514.505036:0:7007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b81b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460514.505058:0:7007:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b81b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460514.505094:0:7007:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460514.505098:0:7007:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460514.505120:0:7007:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b81b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7007 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460514.505145:0:7007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b81ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1637 expref: 7 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460514.505163:0:7007:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b81b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1637 expref: 6 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460514.505245:0:7007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:2.0:1788460514.505249:0:7007:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460514.505252:0:7007:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009200, rc 0) 00000100:00100000:2.0:1788460514.505320:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+6:12156:x1875336462699520:12345-192.168.203.32@tcp:101:lsof.0 Request processed in 410us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460514.505327:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 239 00000100:00080000:0.0:1788460514.505488:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788460514.700551:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460515.561291:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460515.561459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462699648 00000100:00100000:0.0:1788460515.561471:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462699648 00000100:00100000:0.0:1788460515.561533:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 326 00000100:00100000:0.0:1788460515.561544:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462699648:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460515.561627:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2379:x1875336462699648:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 85us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460515.561634:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 326 00000100:00100000:2.0:1788460515.572155:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460515.572370:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460515.572685:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460515.572707:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460515.572759:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462700032 00000100:00100000:0.0:1788460515.572767:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462700032 00000100:00100000:0.0:1788460515.572815:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462699904 00000100:00100000:0.0:1788460515.572818:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462699904 00000100:00100000:0.0:1788460515.572846:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:0.0:1788460515.572855:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462700032:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460515.572918:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2380:x1875336462700032:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 64us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460515.572925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:3.0:1788460515.573146:0:12613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00100000:3.0:1788460515.573154:0:12613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462699904:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460515.573196:0:12613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2379:x1875336462699904:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 43us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460515.573202:0:12613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 70 00000100:00080000:0.0:1788460515.573755:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460515.573761:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460515.574611:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462699776 00000100:00100000:1.0:1788460515.574621:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462699776 00000100:00100000:1.0:1788460515.574669:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462700160 00000100:00100000:1.0:1788460515.574672:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462700160 00000100:00100000:1.0:1788460515.574704:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 158 00000100:00100000:1.0:1788460515.574712:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:2380:x1875336462699776:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460515.574783:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:2380:x1875336462699776:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 71us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460515.574790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 158 00000100:00100000:1.0:1788460515.574806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 159 00000100:00100000:1.0:1788460515.574813:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+6:2379:x1875336462700160:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460515.575843:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ece97008-0c90-48dc-9560-3b476895ed7b+6:2379:x1875336462700160:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 1016us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460515.575853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 159 00010000:00010000:2.0:1788460515.724387:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788460516.406807:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788460516.406842:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788460516.407011:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788460516.407022:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788460516.748664:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460517.773160:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460517.900617:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482605056:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.900688:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460517.900757:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788460517.900764:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482604928:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.900792:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460517.900835:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605056 00000100:00100000:3.0:1788460517.900842:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605056 00000100:00100000:3.0:1788460517.900896:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788460517.900905:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482605056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.900966:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482605056:12345-0@lo:400:kworker.0 Request processed in 62us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460517.900974:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788460517.901019:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482605056:0@lo:400:kworker.0 00000100:00100000:1.0:1788460517.904156:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460517.904194:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482605440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460517.904256:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460517.904303:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605440 00000100:00100000:1.0:1788460517.904309:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605440 00000100:00100000:1.0:1788460517.904348:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788460517.904355:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482605440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460517.904385:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460517.904423:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482605440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460517.904429:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788460517.904467:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482605440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460517.906664:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482604800:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.906748:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460517.906791:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482605312:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.906833:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460517.906877:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788460517.906900:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482604672:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.906930:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460517.906966:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482605184:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.906990:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460517.907026:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605312 00000100:00100000:3.0:1788460517.907034:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605312 00000100:00100000:3.0:1788460517.907082:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788460517.907092:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f60acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482605312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907142:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f60acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482605312:12345-0@lo:400:kworker.0 Request processed in 51us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460517.907156:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788460517.907312:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604672 00000100:00100000:3.0:1788460517.907316:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604672 00000100:00100000:3.0:1788460517.907341:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788460517.907348:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482604672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907380:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d2817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482604672:12345-0@lo:400:kworker.0 Request processed in 32us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460517.907385:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788460517.907408:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604928 00000100:00100000:3.0:1788460517.907412:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604928 00000100:00100000:3.0:1788460517.907436:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482604800 00000100:00100000:3.0:1788460517.907439:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482604800 00000100:00100000:3.0:1788460517.907450:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605184 00000100:00100000:3.0:1788460517.907452:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605184 00000100:00100000:3.0:1788460517.907465:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788460517.907471:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482604928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907508:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482604928:12345-0@lo:400:kworker.0 Request processed in 37us (6715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460517.907522:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788460517.907534:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788460517.907539:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482604800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907567:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482604800:12345-0@lo:400:kworker.0 Request processed in 27us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460517.907573:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788460517.907584:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788460517.907589:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482605184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907614:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482605184:12345-0@lo:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460517.907620:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788460517.907655:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482604672:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907668:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482605184:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907678:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482604800:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907686:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcd79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482605312:0@lo:400:kworker.0 00000100:00100000:3.0:1788460517.907746:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482604928:0@lo:400:kworker.0 00000100:00080000:1.0:1788460517.910411:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460517.910421:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460517.910424:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460517.911265:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460517.911284:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482605568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460517.911349:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460517.911396:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605568 00000100:00100000:0.0:1788460517.911402:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605568 00000100:00100000:0.0:1788460517.911449:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460517.911458:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482605568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460517.911503:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460517.911558:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482605568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460517.911566:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460517.911624:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482605568:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788460517.974531:0:12907:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:35:15 (1788460515) 00010000:00010000:2.0:1788460518.809486:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460519.826173:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460520.680649:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460520.680704:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460520.680755:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460520.680785:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460520.680856:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460520.680939:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462700288 00000100:00100000:0.0:1788460520.680949:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462700288 00000100:00100000:0.0:1788460520.681007:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 328 00000100:00100000:0.0:1788460520.681021:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462700288:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460520.681087:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2381:x1875336462700288:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460520.681105:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 328 00000100:00100000:3.0:1788460520.681471:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462700544 00000100:00100000:3.0:1788460520.681477:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462700544 00000100:00100000:3.0:1788460520.681540:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462700672 00000100:00100000:3.0:1788460520.681544:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462700672 00000100:00100000:3.0:1788460520.681571:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1788460520.681580:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462700544:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460520.681623:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2381:x1875336462700544:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 45us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460520.681641:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 73 00000100:00100000:3.0:1788460520.681654:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:3.0:1788460520.681659:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462700672:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460520.681682:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2381:x1875336462700672:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460520.681688:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:3.0:1788460520.681704:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462700800 00000100:00100000:3.0:1788460520.681707:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462700800 00000100:00100000:3.0:1788460520.681730:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462700416 00000100:00100000:3.0:1788460520.681732:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462700416 00000100:00100000:3.0:1788460520.681746:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:3.0:1788460520.681751:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+6:2381:x1875336462700800:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460520.681775:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ece97008-0c90-48dc-9560-3b476895ed7b+6:2381:x1875336462700800:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460520.681781:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 163 00000100:00100000:3.0:1788460520.681790:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00100000:3.0:1788460520.681796:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:2381:x1875336462700416:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460520.681813:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:2381:x1875336462700416:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 18us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460520.681819:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 164 00000100:00080000:0.0:1788460520.682358:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460520.682364:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460520.682366:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788460520.846653:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460521.868395:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460522.262132:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460522.262587:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462701056 00000100:00100000:0.0:1788460522.262598:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462701056 00000100:00100000:0.0:1788460522.262675:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00100000:0.0:1788460522.262687:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+18:12377:x1875336462701056:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:0.0:1788460522.263090:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:12377:x1875336462701056:12345-192.168.203.32@tcp:35:umount.0 Request processed in 404us (965us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788460522.263098:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 66 00000100:00080000:1.0:1788460522.263171:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460522.266700:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460522.266963:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462701312 00000100:00100000:3.0:1788460522.266974:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462701312 00000100:00100000:3.0:1788460522.267028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:3.0:1788460522.267038:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+19:12377:x1875336462701312:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:3.0:1788460522.267600:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:12377:x1875336462701312:12345-192.168.203.32@tcp:35:umount.0 Request processed in 560us (907us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788460522.267610:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 67 00000100:00100000:2.0:1788460522.276229:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460522.276338:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462701568 00000100:00100000:3.0:1788460522.276349:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462701568 00000100:00100000:3.0:1788460522.276413:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:3.0:1788460522.276423:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d286bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+20:12377:x1875336462701568:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:3.0:1788460522.277000:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d286bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:12377:x1875336462701568:12345-192.168.203.32@tcp:35:umount.0 Request processed in 575us (778us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788460522.277011:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 68 00000100:00100000:1.0:1788460522.280590:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460522.281629:0:12105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462701824 00000100:00100000:0.0:1788460522.281643:0:12105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462701824 00000100:00100000:0.0:1788460522.281898:0:12105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:0.0:1788460522.281931:0:12105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+21:12377:x1875336462701824:12345-192.168.203.32@tcp:35:umount.0 00000100:00100000:0.0:1788460522.282304:0:12105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:12377:x1875336462701824:12345-192.168.203.32@tcp:35:umount.0 Request processed in 374us (1722us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788460522.282312:0:12105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 69 00000100:00100000:1.0:1788460522.291750:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460522.291856:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462701952 00000100:00100000:2.0:1788460522.291866:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462701952 00000100:00100000:2.0:1788460522.291939:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460522.291964:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462701952:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460522.291981:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460522.292000:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166fe00/0x889bb893541b7226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11bb expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.292018:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460522.292083:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:2380:x1875336462701952:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 121us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460522.292090:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460522.292781:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460522.292843:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462702464 00000100:00100000:3.0:1788460522.292849:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462702464 00000100:00100000:3.0:1788460522.292941:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00100000:3.0:1788460522.292951:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2378:x1875336462702464:12345-192.168.203.32@tcp:9:umount.0 00000020:00000080:3.0:1788460522.292977:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7766 00000020:00010000:3.0:1788460522.292984:0:6701:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9650c5014000: total 0 00000100:00080000:3.0:1788460522.292989:0:6701:0:(import.c:65:import_set_state_nolock()) ffff9650c5015800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460522.293031:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788460522.293327:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2378:x1875336462702464:12345-192.168.203.32@tcp:9:umount.0 Request processed in 377us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460522.293335:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 74 00000100:00080000:1.0:1788460522.293390:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1788460522.298160:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9650c5014000: total 0 00010000:00010000:2.0:1788460522.298264:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9650c5014000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788460522.298338:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a932fca5/0x889bb893541b81a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1630 expref: 4 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.298381:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfe0ea1a/0x889bb893541b7b09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1462 expref: 3 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.298400:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9650c5014000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788460522.298412:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460522.298414:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460522.298416:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460522.307000:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460522.307075:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460522.307114:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460522.307144:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462702080 00000100:00100000:1.0:1788460522.307153:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462702080 00000100:00100000:1.0:1788460522.307264:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462702592 00000100:00100000:1.0:1788460522.307268:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462702592 00000100:00100000:1.0:1788460522.307292:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462702720 00000100:00100000:1.0:1788460522.307311:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462702720 00000100:00100000:1.0:1788460522.307347:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1788460522.307357:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+15:2380:x1875336462702080:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460522.307374:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460522.307394:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d600/0x889bb893541b7417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d128d expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460522.307412:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460522.307464:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+14:2380:x1875336462702080:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 107us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460522.307471:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1788460522.307488:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460522.307494:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:2379:x1875336462702592:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460522.307502:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460522.307511:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008800/0x889bb893541b722d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11c2 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460522.307520:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460522.307537:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:2379:x1875336462702592:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 44us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460522.307543:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460522.307556:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1788460522.307563:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+11:2380:x1875336462702720:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460522.307570:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460522.307579:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008e00/0x889bb893541b7170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1183 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460522.307598:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460522.307618:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2380:x1875336462702720:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 55us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460522.307624:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1788460522.313524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460522.313637:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462702848 00000100:00100000:3.0:1788460522.313648:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462702848 00000100:00100000:3.0:1788460522.313719:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:3.0:1788460522.313730:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+5:2378:x1875336462702848:12345-192.168.203.32@tcp:9:umount.0 00000020:00000080:3.0:1788460522.313777:0:8864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7505 00000100:00080000:3.0:1788460522.313787:0:8864:0:(import.c:65:import_set_state_nolock()) ffff9650fd269800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460522.313832:0:8864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1788460522.314201:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460522.314384:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460522.315444:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+2:2378:x1875336462702848:12345-192.168.203.32@tcp:9:umount.0 Request processed in 1708us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460522.315456:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 75 00000100:00100000:1.0:1788460522.332269:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460522.332750:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462703872 00000100:00100000:3.0:1788460522.332761:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462703872 00000100:00100000:3.0:1788460522.332838:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 240 00000100:00100000:3.0:1788460522.332849:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+22:2378:x1875336462703872:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:3.0:1788460522.332885:0:7007:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b717e 00000020:00010000:3.0:1788460522.332901:0:7007:0:(genops.c:1921:obd_stale_export_put()) Put export ffff964fc12d5000: total 0 00000100:00080000:3.0:1788460522.332906:0:7007:0:(import.c:65:import_set_state_nolock()) ffff964fc12d0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460522.332943:0:7007:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1788460522.333004:0:7659:0:(genops.c:1907:obd_stale_export_get()) Get export ffff964fc12d5000: total 0 00010000:00010000:2.0:1788460522.333059:0:7659:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff964fc12d5000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788460522.333089:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650c34d0c00) 00010000:00010000:2.0:1788460522.333093:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460522.333114:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b746b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d129b expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333143:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460522.333146:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788460522.333150:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009a00/0x889bb893541b7af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d145b expref: 20 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333163:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460522.333165:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460522.333169:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b800/0x889bb893541b7e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1557 expref: 19 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333225:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460522.333228:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788460522.333232:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b8192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1629 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333256:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460522.333258:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460522.333261:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5b000/0x889bb893541b8088 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d15e3 expref: 17 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333272:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:2.0:1788460522.333275:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460522.333278:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b77c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1389 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333288:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9650d2c3ce00) 00010000:00010000:2.0:1788460522.333296:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460522.333301:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a200/0x889bb893541b7b87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1485 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333319:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460522.333322:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460522.333325:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5a000/0x889bb893541b79ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1415 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333338:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9650d2c3cf00) 00010000:00010000:2.0:1788460522.333341:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460522.333345:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5ae00/0x889bb893541b74db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12b7 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333363:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9650c52ed200) 00010000:00010000:2.0:1788460522.333366:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460522.333369:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008000/0x889bb893541b8168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d161b expref: 12 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333385:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:2.0:1788460522.333388:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460522.333391:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008200/0x889bb893541b7b6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d147e expref: 11 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333407:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650d2c3c200) 00010000:00010000:2.0:1788460522.333409:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460522.333414:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650fcd5be00/0x889bb893541b7487 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d12a2 expref: 10 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333444:0:7659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9650c3cb0200) 00010000:00010000:2.0:1788460522.333447:0:7659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460522.333451:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b7aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d144d expref: 9 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460522.333465:0:7659:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff964fc12d5000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788460522.333481:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460522.333485:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460522.333488:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460522.333650:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e69358b-6b5d-4a87-b6fb-534c610a3920+7:2378:x1875336462703872:12345-192.168.203.32@tcp:39:umount.0 Request processed in 802us (1389us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788460522.333659:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 240 00000040:00080000:1.0:1788460522.892528:0:11722:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460522.892537:0:11722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1788460522.892579:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460522.893021:0:11722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788460522.893030:0:11722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460523.020459:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482606080:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.020531:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460523.020549:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482605952:0@lo:400:kworker.0 00000100:00100000:0.0:1788460523.020593:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460523.023421:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605952 00000100:00100000:0.0:1788460523.023434:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605952 00000100:00100000:0.0:1788460523.023492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788460523.023502:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482605952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460523.023577:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482605952:12345-0@lo:400:kworker.0 Request processed in 78us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460523.023583:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1788460523.023606:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460523.023621:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482606464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460523.023651:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460523.023691:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482605952:0@lo:400:kworker.0 00000100:00100000:0.0:1788460523.023711:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460523.023833:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482606592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460523.023859:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460523.023890:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606464 00000100:00100000:0.0:1788460523.023894:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606464 00000100:00100000:0.0:1788460523.023930:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606592 00000100:00100000:0.0:1788460523.023933:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606592 00000100:00100000:0.0:1788460523.023947:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460523.023953:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482606464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460523.023993:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460523.024030:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482606464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460523.024037:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460523.024049:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788460523.024056:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482606592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460523.024072:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788460523.024097:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482606592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460523.024103:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788460523.024119:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460523.024121:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460523.024145:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482606592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460523.024156:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482606464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460523.024214:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606080 00000100:00100000:0.0:1788460523.024219:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606080 00000100:00100000:0.0:1788460523.024324:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788460523.024331:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482606080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460523.025740:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482606080:12345-0@lo:400:kworker.0 Request processed in 1403us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460523.025754:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788460523.025837:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482606080:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.026589:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482605824:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.026650:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460523.026693:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482606336:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.026716:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460523.026744:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788460523.026751:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482605696:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.026776:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460523.026800:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482606208:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.026821:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460523.026858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605824 00000100:00100000:1.0:1788460523.026865:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605824 00000100:00100000:1.0:1788460523.026903:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606208 00000100:00100000:1.0:1788460523.026930:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606208 00000100:00100000:1.0:1788460523.026984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788460523.026992:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482605824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.027045:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482605824:12345-0@lo:400:kworker.0 Request processed in 54us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460523.027052:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788460523.027066:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788460523.027072:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482606208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.027535:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482606208:12345-0@lo:400:kworker.0 Request processed in 462us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460523.027542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788460523.027581:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482606208:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.027591:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482605824:0@lo:400:kworker.0 00000100:00080000:1.0:1788460523.027618:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460523.027668:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606336 00000100:00100000:1.0:1788460523.027672:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606336 00000100:00100000:1.0:1788460523.027701:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460523.027707:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482606336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.027742:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482606336:12345-0@lo:400:kworker.0 Request processed in 35us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460523.027749:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460523.027772:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482606336:0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.027813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482605696 00000100:00100000:1.0:1788460523.027817:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482605696 00000100:00100000:1.0:1788460523.027842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788460523.027849:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482605696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460523.027895:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482605696:12345-0@lo:400:kworker.0 Request processed in 46us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460523.027902:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788460523.028168:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482605696:0@lo:400:kworker.0 00000001:00100000:2.0:1788460523.105616:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:2.0:1788460523.105626:0:6730:0:(genops.c:885:class_export_put()) final put ffff9650fd268800/9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:1.0:1788460523.106228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fd268800/9e69358b-6b5d-4a87-b6fb-534c610a3920 for lustre-OST0000 00000020:00000080:1.0:1788460523.106294:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fd269800 for lustre-OST0000 00010000:00010000:2.0:1788460523.916322:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460524.273283:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460524.273330:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460524.273360:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460524.273403:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460524.273474:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462704000 00000100:00100000:2.0:1788460524.273484:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462704000 00000100:00100000:2.0:1788460524.273534:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462704256 00000100:00100000:2.0:1788460524.273537:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462704256 00000100:00100000:2.0:1788460524.273551:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462704128 00000100:00100000:2.0:1788460524.273553:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462704128 00000100:00100000:2.0:1788460524.273562:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462704384 00000100:00100000:2.0:1788460524.273563:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462704384 00000100:00100000:2.0:1788460524.273580:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1788460524.273589:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+13:2382:x1875336462704000:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460524.273604:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460524.273623:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167800/0x889bb893541b7273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11d7 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460524.273640:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460524.273763:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+12:2382:x1875336462704000:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 174us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460524.273780:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1788460524.273809:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1788460524.273816:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+11:2382:x1875336462704256:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460524.273825:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460524.273835:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166e600/0x889bb893541b7410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1286 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460524.273845:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460524.273864:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+10:2382:x1875336462704256:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 49us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460524.273871:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1788460524.273883:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1788460524.273889:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+9:2382:x1875336462704128:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460524.273906:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460524.273915:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5200/0x889bb893541b727a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1201 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460524.273923:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460524.273953:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+8:2382:x1875336462704128:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 52us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460524.273959:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1788460524.273981:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1788460524.273988:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+7:2381:x1875336462704384:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460524.273995:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460524.274011:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4600/0x889bb893541b726c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d11d0 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460524.274019:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460524.274038:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+6:2381:x1875336462704384:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 51us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460524.274045:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:1.0:1788460524.287883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460524.288841:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462704640 00000100:00100000:0.0:1788460524.288854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462704640 00000100:00100000:0.0:1788460524.289057:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 241 00000100:00100000:0.0:1788460524.289082:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+6:2378:x1875336462704640:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:0.0:1788460524.289330:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7288 00000020:00010000:0.0:1788460524.289340:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff964fc3da1000: total 0 00000100:00080000:0.0:1788460524.289344:0:5844:0:(import.c:65:import_set_state_nolock()) ffff964fc3da5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460524.289368:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788460524.289576:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ece97008-0c90-48dc-9560-3b476895ed7b+5:2378:x1875336462704640:12345-192.168.203.32@tcp:39:umount.0 Request processed in 497us (1712us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788460524.289584:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 241 00000020:00010000:2.0:1788460524.289737:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff964fc3da1000: total 0 00010000:00010000:2.0:1788460524.289782:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff964fc3da1000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788460524.289810:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0900) 00010000:00010000:2.0:1788460524.289813:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460524.289820:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009200/0x889bb893541b81b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1637 expref: 4 pid: 7007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460524.289843:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff964fc3da1000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788460524.289852:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460524.289854:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460524.289856:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460524.290456:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460524.318074:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460524.318233:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462704768 00000100:00100000:2.0:1788460524.318243:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462704768 00000100:00100000:2.0:1788460524.318298:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 330 00000100:00100000:2.0:1788460524.318309:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+6:2378:x1875336462704768:12345-192.168.203.32@tcp:251:umount.0 00000020:00000080:2.0:1788460524.318361:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b715b 00000100:00080000:2.0:1788460524.318371:0:5836:0:(import.c:65:import_set_state_nolock()) ffff964fc3da0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788460524.318453:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e8918850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0+1:2378:x1875336462704768:12345-192.168.203.32@tcp:251:umount.0 Request processed in 146us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460524.318461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 330 00000020:00000080:2.0:1788460524.318470:0:5836:0:(genops.c:885:class_export_put()) final put ffff964fc3da5000/f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0 00000020:00000080:2.0:1788460524.318513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc3da5000/f2ed7d77-14cd-4e2c-87cb-868ebc51a1e0 for MGS 00000020:00000080:2.0:1788460524.318547:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc3da0000 for MGS 00010000:00010000:3.0:1788460524.318732:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460524.940295:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788460525.961037:0:13105:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00010000:00010000:2.0:1788460525.965283:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788460525.977425:0:13105:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788460525.977476:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.977492:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.977500:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.977525:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.977553:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788460525.977558:0:13105:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788460525.977581:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460525.977585:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788460525.977590:0:13105:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788460525.977615:0:13105:0:(import.c:65:import_set_state_nolock()) ffff9650ea76e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788460525.978124:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460525.978132:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.978141:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460525.978144:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.978153:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460525.978159:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460525.978164:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460525.978167:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:2.0:1788460525.978170:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788460525.978235:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.978242:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460525.978267:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.978273:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0030e00/0x889bb893541b71fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7203 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.978296:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460525.978298:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460525.978300:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460525.978372:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460525.978391:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482606848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460525.978456:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460525.978518:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606848 00000100:00100000:2.0:1788460525.978526:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606848 00000100:00100000:0.0:1788460525.978567:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482606720:0@lo:39:umount.0 00000100:00100000:2.0:1788460525.978584:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788460525.978595:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3317:x1875336482606848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460525.978607:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788460525.978607:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460525.978623:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166f000/0x889bb893541b7203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b71fc expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.978637:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460525.978658:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606720 00000100:00100000:0.0:1788460525.978663:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606720 00000100:00100000:2.0:1788460525.978684:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:3317:x1875336482606848:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460525.978691:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788460525.978727:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482606848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460525.978797:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788460525.978805:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875336482606720:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788460525.978825:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6f16 00000100:00080000:0.0:1788460525.978834:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf5800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788460525.979240:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3315:x1875336482606720:12345-0@lo:39:umount.0 Request processed in 433us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460525.979249:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788460525.979261:0:5842:0:(genops.c:885:class_export_put()) final put ffff96510150f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788460525.979286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff96510150f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1788460525.979290:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788460525.979332:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650d0bf5800 for lustre-MDT0000 00000100:00080000:3.0:1788460525.979376:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650ea76e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788460525.979396:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482606720:0@lo:39:umount.0 00000100:00080000:2.0:1788460525.979445:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788460525.979449:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788460525.979454:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788460525.980399:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980414:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980439:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980445:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980468:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460525.980475:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980481:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980488:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980494:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980508:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788460525.980514:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980520:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980526:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980543:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980558:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788460525.980570:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460525.980575:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980581:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460525.980585:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980593:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460525.980601:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460525.980607:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788460525.980608:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1788460525.980611:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 00010000:00010000:1.0:1788460525.980616:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.980626:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460525.980630:0:7658:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.980638:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980643:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460525.980647:0:7658:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980656:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1788460525.980660:0:7658:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788460525.980671:0:7658:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788460525.980674:0:7658:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788460525.980679:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980687:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4400/0x889bb893541b720a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.980708:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980712:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460525.980717:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.980719:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460525.980728:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166ee00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460525.980732:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.980739:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980740:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.980759:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b7115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b711c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460525.980760:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460525.980778:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788460525.980781:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:2.0:1788460525.980783:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788460525.980784:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460525.980787:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460525.980789:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460525.980804:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482607104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460525.980812:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980819:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460525.980827:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980834:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c166ee00/0x889bb893541b743a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7441 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.980844:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460525.980846:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460525.980853:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460525.980858:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460525.980869:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482606976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460525.980914:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460525.980919:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460525.980930:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482607232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460525.980957:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482607104 00000100:00100000:1.0:1788460525.980958:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460525.980965:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482607104 00000100:00100000:1.0:1788460525.980995:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482606976 00000100:00100000:1.0:1788460525.981001:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482606976 00000100:00100000:2.0:1788460525.981010:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482607232 00000100:00100000:1.0:1788460525.981030:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460525.981038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+23:3318:x1875336482607104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460525.981047:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460525.981059:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5c00/0x889bb893541b711c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b7115 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.981069:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460525.981100:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+22:3318:x1875336482607104:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460525.981113:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460525.981128:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788460525.981135:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+21:3317:x1875336482606976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460525.981142:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460525.981152:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009800/0x889bb893541b7211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b720a expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.981159:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460525.981218:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3317:x1875336482606976:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460525.981225:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788460525.981238:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460525.981259:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482606976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460525.981281:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482607104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460525.982316:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982331:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982339:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982346:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982381:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460525.982388:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982394:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982399:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982405:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.982417:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788460525.982420:0:13105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788460525.982439:0:13105:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788460525.982459:0:13105:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788460525.982463:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788460525.982467:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460525.982473:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1788460525.982479:0:13105:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9650fd26d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460525.982484:0:13105:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9650fc7a3800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460525.982491:0:13105:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff964fc3da1000 ece97008-0c90-48dc-9560-3b476895ed7b 192.168.203.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460525.982496:0:13105:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff964fc12d5000 9e69358b-6b5d-4a87-b6fb-534c610a3920 192.168.203.32@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:3.0:1788460525.982500:0:13105:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9650c3810000) has exports, disconnecting them 00000020:00080000:3.0:1788460525.982504:0:13105:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9650fd26d000), last request at 1788460523 00000020:00000080:3.0:1788460525.982511:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b70b3 00000100:00080000:3.0:1788460525.982532:0:13105:0:(import.c:65:import_set_state_nolock()) ffff9650fd268000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788460525.988306:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482607232 00000100:00100000:2.0:1788460525.988394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460525.988406:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3318:x1875336482607232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460525.988421:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460525.988441:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650fcd5b400/0x889bb893541b7441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b743a expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.988459:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460525.988531:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:3318:x1875336482607232:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (7572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460525.988538:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460525.988581:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482607232:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788460525.989618:0:13105:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650fd26d000): rc 0 00000020:00000080:3.0:1788460525.989624:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650fd26d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788460525.989637:0:13105:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9650fc7a3800), last request at 1788460523 00000020:00000080:3.0:1788460525.989644:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6fbe 00000100:00080000:3.0:1788460525.989653:0:13105:0:(import.c:65:import_set_state_nolock()) ffff9650fc7a5800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788460525.989667:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460525.989674:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.989696:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460525.989704:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.989714:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460525.989719:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.989728:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460525.989739:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788460525.989754:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460525.989760:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460525.989763:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:2.0:1788460525.989767:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788460525.989818:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.989825:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460525.989849:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.989857:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b7218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b721f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460525.989871:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460525.989873:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460525.989877:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460525.989902:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482607360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460525.989911:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460525.989916:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.989924:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460525.989931:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460525.989936:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460525.989939:0:5830:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:3.0:1788460525.989941:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788460525.989961:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460525.990290:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.990298:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460525.990319:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.990326:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b6e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b6e7c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460525.990341:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788460525.990349:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460525.990352:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460525.990354:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482607488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460525.990355:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788460525.990371:0:13105:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650fc7a3800): rc 0 00000020:00000080:3.0:1788460525.990375:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650fc7a3800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788460525.990384:0:13105:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa77dc1c87ae0 00000100:00100000:2.0:1788460525.990391:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788460525.990405:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788460525.990410:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788460525.990424:0:13105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788460525.990482:0:13105:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788460525.990495:0:13105:0:(import.c:65:import_set_state_nolock()) ffff964fc13c6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788460525.990515:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788460525.990517:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1788460525.990525:0:13105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788460525.990574:0:13105:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788460525.990582:0:13105:0:(import.c:65:import_set_state_nolock()) ffff9650c7cfe000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788460525.990623:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9650c3810000) has no exports 00000100:00100000:2.0:1788460525.990695:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482607616:0@lo:9:umount.0 00000100:00100000:2.0:1788460525.990727:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460525.990751:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482607744:0@lo:9:umount.0 00000100:00100000:1.0:1788460525.990768:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482607616 00000100:00100000:1.0:1788460525.990775:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482607616 00000100:00100000:2.0:1788460525.990787:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460525.990824:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482607744 00000100:00100000:1.0:1788460525.990828:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482607744 00000100:00100000:1.0:1788460525.990856:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460525.990866:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875336482607616:12345-0@lo:9:umount.0 00000100:00100000:2.0:1788460525.990878:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000020:00000080:1.0:1788460525.990895:0:8864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7035 00000100:00100000:2.0:1788460525.990900:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875336482607744:12345-0@lo:9:umount.0 00000100:00080000:1.0:1788460525.990905:0:8864:0:(import.c:65:import_set_state_nolock()) ffff9650c7cff800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788460525.990919:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7146 00000100:00080000:2.0:1788460525.990928:0:6701:0:(import.c:65:import_set_state_nolock()) ffff964fc3da0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460525.990935:0:8864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000001:00000004:2.0:1788460525.990961:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788460525.991138:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3315:x1875336482607744:12345-0@lo:9:umount.0 Request processed in 252us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460525.991147:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788460525.991212:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650c7cfe000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788460525.991217:0:3315:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788460525.991219:0:3315:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788460525.991222:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482607744:0@lo:9:umount.0 00010000:00010000:2.0:1788460525.991239:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460525.991497:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460525.991522:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482607360 00000100:00100000:0.0:1788460525.991526:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482607360 00000100:00100000:0.0:1788460525.991564:0:7669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482607488 00000100:00100000:0.0:1788460525.991567:0:7669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482607488 00000100:00100000:0.0:1788460525.991589:0:7669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788460525.991597:0:7669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce24ccd6-bef2-4d18-b934-4ac2305873bc+20:3316:x1875336482607360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460525.991616:0:7669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460525.991631:0:7669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009600/0x889bb893541b721f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b7218 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460525.991642:0:7669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460525.991677:0:7669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:3316:x1875336482607360:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460525.991771:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788460525.991779:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+19:3316:x1875336482607488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460525.991787:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460525.991796:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166f200/0x889bb893541b6e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b6e75 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460525.991808:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460525.991813:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3315:x1875336482607616:12345-0@lo:9:umount.0 Request processed in 950us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460525.991821:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788460525.991829:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce24ccd6-bef2-4d18-b934-4ac2305873bc+18:3316:x1875336482607488:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460525.991835:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788460525.991844:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460525.991847:0:5838:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460525.991868:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc13c6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788460525.991877:0:3315:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788460525.991879:0:3315:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788460525.991882:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482607616:0@lo:9:umount.0 00010000:00010000:1.0:1788460525.991912:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460525.991940:0:7669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00000080:0.0:1788460525.992050:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fd26d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788460525.992087:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fc7a3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788460525.992113:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fd268000 for lustre-MDT0000 00000020:00000080:0.0:1788460525.992117:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fc7a5800 for lustre-MDT0000 00000100:00100000:0.0:1788460525.992142:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c4fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482607488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460525.992152:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482607360:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788460526.004672:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9650c3810000) has no exports 00000020:00000080:3.0:1788460526.055757:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6ed0 00000020:00000080:3.0:1788460526.055774:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650f5c63000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788460526.055963:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788460526.056047:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460526.056058:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788460526.056064:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9650f5eb3310) has no exports 00000020:00000080:2.0:1788460526.056552:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6ec9 00000020:00000080:2.0:1788460526.056558:0:13105:0:(genops.c:885:class_export_put()) final put ffff9651014a0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788460526.056601:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5c63000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788460526.056706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9651014a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788460526.056767:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460526.056775:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788460526.056779:0:13105:0:(genops.c:885:class_export_put()) final put ffff965101dae000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788460526.056781:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff965101dae000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788460526.056787:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:3.0:1788460526.651010:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ece97008-0c90-48dc-9560-3b476895ed7b 00000001:00080000:3.0:1788460526.651033:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788460526.651039:0:5864:0:(genops.c:885:class_export_put()) final put ffff964fc3da1000/ece97008-0c90-48dc-9560-3b476895ed7b 00000001:00080000:3.0:1788460526.651062:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1788460526.651075:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000001:00080000:3.0:1788460526.651080:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788460526.651095:0:5864:0:(genops.c:885:class_export_put()) final put ffff964fc12d5000/9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:1.0:1788460526.651176:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc3da1000/ece97008-0c90-48dc-9560-3b476895ed7b for lustre-MDT0000 00000020:00000080:1.0:1788460526.659747:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc12d5000/9e69358b-6b5d-4a87-b6fb-534c610a3920 for lustre-MDT0000 00000020:00000080:1.0:1788460526.659891:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc3da5800 for lustre-MDT0000 00000020:00000080:1.0:1788460526.659896:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc12d0000 for lustre-MDT0000 00010000:00010000:3.0:1788460526.988423:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788460527.171317:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460527.171325:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650efd49800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788460527.171404:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650efd49800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788460527.171451:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc3da0800 for lustre-OST0001 00000001:00100000:3.0:1788460527.171588:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:3.0:1788460527.171592:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650c5014000/9e69358b-6b5d-4a87-b6fb-534c610a3920 00000020:00000080:1.0:1788460527.171670:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c5014000/9e69358b-6b5d-4a87-b6fb-534c610a3920 for lustre-OST0001 00000020:00000080:1.0:1788460527.171697:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c5015800 for lustre-OST0001 00010000:00010000:2.0:1788460528.012780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788460528.076312:0:13105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650f6102960 - data ffff965100341e58/ffff9650fd25e800 00000020:01000000:2.0:1788460528.076448:0:13105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650ea546a20 - data ffff96510035ee58/ffff9650f584f000 00000001:00000004:2.0:1788460528.090475:0:13105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788460528.140439:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482607872:0@lo:400:kworker.0 00000100:00100000:0.0:1788460528.140494:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460528.140543:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460528.140547:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482608000:0@lo:400:kworker.0 00000100:00100000:0.0:1788460528.140568:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460528.140611:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482608128:0@lo:400:kworker.0 00000100:00100000:0.0:1788460528.140638:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460528.140671:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608000 00000100:00100000:0.0:1788460528.140678:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608000 00000100:00100000:0.0:1788460528.140724:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608128 00000100:00100000:3.0:1788460528.141077:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482607872 00000100:00100000:2.0:1788460528.141083:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788460528.141084:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482607872 00000100:00100000:2.0:1788460528.141101:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3318:x1875336482608000:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788460528.141110:0:7007:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788460528.141124:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788460528.141133:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:3318:x1875336482607872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460528.141160:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3318:x1875336482608000:12345-0@lo:400:kworker.0 Request processed in 59us (589us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460528.141168:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788460528.141202:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e891b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce24ccd6-bef2-4d18-b934-4ac2305873bc+17:3318:x1875336482607872:12345-0@lo:400:kworker.0 Request processed in 70us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460528.141210:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788460528.141255:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608128 00000100:00080000:0.0:1788460528.141339:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788460528.141344:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9650f5c62800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788460528.141348:0:3318:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788460528.144226:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788460528.144235:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1875336482608128:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788460528.144244:0:5843:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788460528.144713:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1875336482608128:12345-0@lo:400:kworker.0 Request processed in 475us (4071us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460528.144722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788460528.147239:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788460528.147246:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9650fd26e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788460528.147324:0:3316:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788460528.147329:0:3316:0:(import.c:65:import_set_state_nolock()) ffff9650fd26e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460528.147333:0:3316:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 215 00000100:00080000:2.0:1788460528.147342:0:3316:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9650fd26e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460528.147374:0:3316:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650ec037b80 x1875336482608256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460528.147616:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482608128:0@lo:400:kworker.0 00000100:00100000:2.0:1788460528.148061:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482608256:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788460528.148140:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460528.148215:0:7007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608256 00000100:00100000:2.0:1788460528.148222:0:7007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608256 00000100:00100000:2.0:1788460528.148627:0:7007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788460528.148644:0:7007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3315:x1875336482608256:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788460528.148661:0:7007:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788460528.164892:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9650f5c62800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460528.164902:0:3318:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 195 00000100:00080000:0.0:1788460528.164911:0:3318:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9650f5c62800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460528.165028:0:3318:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650f6055f80 x1875336482608384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788460528.165053:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482608000:0@lo:400:kworker.0 00000100:00100000:0.0:1788460528.165074:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482608384:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788460528.165140:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460528.166472:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608384 00000100:00100000:0.0:1788460528.166612:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608384 00000100:00100000:0.0:1788460528.166654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788460528.166663:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482608384:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788460528.166681:0:5842:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788460528.166755:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482608384:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 92us (1614us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788460528.166762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788460528.167126:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5c62800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460528.167144:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788460528.167149:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482608384:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788460528.168841:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3318:1875336482607872:0@lo:400:kworker.0 00000100:00100000:2.0:1788460528.179894:0:7007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3315:x1875336482608256:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31243us (31746us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788460528.179907:0:7007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788460528.181840:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650fd26e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460528.181852:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788460528.181857:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482608256:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788460528.212409:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788460528.212418:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788460528.212436:0:13105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788460528.212452:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000001:00100000:2.0:1788460528.218044:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788460528.218055:0:6730:0:(genops.c:885:class_export_put()) final put ffff9650c7cf8800/lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1788460528.218403:0:6727:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788460528.218408:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788460528.218419:0:6727:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788460528.219486:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788460528.219492:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788460528.219511:0:13105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788460528.219514:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460528.219767:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c7cf8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788460528.219815:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c7cff800 for lustre-OST0000 00000004:00080000:2.0:1788460528.220013:0:7951:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788460528.220018:0:7951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788460528.220026:0:7951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788460528.290409:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6e98 00000020:00000080:3.0:1788460528.290423:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650f613e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460528.292053:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6ead 00000020:00000080:3.0:1788460528.292064:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650f6143000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788460528.292172:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f613e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788460528.292885:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788460528.292978:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460528.292988:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788460528.292993:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9650c3811988) has no exports 00000004:01000000:3.0:1788460528.293251:0:13105:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788460528.293266:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b713f 00000020:00000080:3.0:1788460528.293272:0:13105:0:(genops.c:885:class_export_put()) final put ffff964fc2383800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788460528.293284:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788460528.293289:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460528.293296:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788460528.293298:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9650f5eb0000) has no exports 00000020:00000080:3.0:1788460528.293304:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7138 00000020:00000080:3.0:1788460528.293361:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650c7cfa800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788460528.293789:0:13105:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788460528.293794:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788460528.293798:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788460528.293803:0:13105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460528.293805:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460528.293898:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460528.293906:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788460528.293912:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7012 00000020:00000080:3.0:1788460528.293916:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650c7cfd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788460528.293921:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788460528.293924:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460528.293928:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788460528.293931:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff964fc2270000) has no exports 00000020:00000080:3.0:1788460528.293935:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b700b 00000020:00000080:3.0:1788460528.293937:0:13105:0:(genops.c:885:class_export_put()) final put ffff964fc13c4800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788460528.294256:0:13105:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788460528.294259:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788460528.294262:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788460528.294265:0:13105:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460528.294275:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460528.294309:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460528.294314:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788460528.294339:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460528.294342:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788460528.294377:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6eb4 00000020:00000080:3.0:1788460528.294382:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650f6140800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788460528.294387:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788460528.294390:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460528.294393:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788460528.294396:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9650c3816620) has no exports 00000020:00000080:3.0:1788460528.294420:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460528.294424:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788460528.294427:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6ebb 00000020:00000080:3.0:1788460528.294429:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650f6146000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788460528.294437:0:13105:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650c5118800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788460528.294440:0:13105:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c5118800 3 00000020:01000004:3.0:1788460528.294442:0:13105:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9650c5118800 from lustre-MDT0000 00000020:00000080:3.0:1788460528.294461:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460528.294464:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788460528.294467:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650f613c800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788460528.294469:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f613c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788460528.294597:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788460528.294663:0:13105:0:(obd_mount.c:666:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788460528.294667:0:13105:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788460528.294670:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788460528.294673:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460528.294676:0:13105:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788460528.294681:0:13105:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9650d1056000 ce24ccd6-bef2-4d18-b934-4ac2305873bc 0@lo 16 (0 0 11) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460528.294686:0:13105:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9650d1198000) has exports, disconnecting them 00000020:00080000:3.0:1788460528.294690:0:13105:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9650d1056000), last request at 1788460304 00000020:00000080:3.0:1788460528.294703:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6e59 00000020:00010000:3.0:1788460528.294713:0:13105:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9650d1056000: total 7 00000100:00080000:3.0:1788460528.294717:0:13105:0:(import.c:65:import_set_state_nolock()) ffff9650d1057000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788460528.294732:0:13105:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650d1056000): rc 0 00000020:00080000:3.0:1788460528.294736:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9650d1198000) has no exports 00000020:00010000:3.0:1788460528.294807:0:7659:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9650d1056000: total 7 00010000:00010000:3.0:1788460528.294811:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460528.294832:0:7659:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9650d1056000, canceled 0 locks, left on hash table 11. 00010000:00010000:3.0:1788460528.294859:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166ec00/0x889bb893541b71af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b71a8 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294886:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5800/0x889bb893541b71bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b71b6 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294903:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102166000/0x889bb893541b6f63 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b6f5c expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294917:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008400/0x889bb893541b71d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b71d2 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294930:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166fa00/0x889bb893541b71cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b71c4 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294940:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166e000/0x889bb893541b7433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b742c expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294949:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c0030800/0x889bb893541b71e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b71e0 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294958:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166ea00/0x889bb893541b7425 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b741e expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294968:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c166f800/0x889bb893541b71f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b71ee expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294989:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167600/0x889bb893541b70c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b70c1 expref: 3 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.294999:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167200/0x889bb893541b70e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b70dd expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460528.295009:0:7659:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9650d1056000, canceled 11 locks, left on hash table 0. 00000020:00000080:3.0:1788460528.295021:0:7659:0:(genops.c:885:class_export_put()) final put ffff9650d1056000/ce24ccd6-bef2-4d18-b934-4ac2305873bc 00010000:00010000:3.0:1788460528.295026:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460528.295028:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460528.295029:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460528.295087:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9650d029a800:5837] 2 exiting: rc = 0 00000100:00100000:3.0:1788460528.295196:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9650d32e3c00:5836] 1 exiting: rc = 0 00000020:00000080:2.0:1788460528.295408:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6143000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788460528.295414:0:38:0:(genops.c:885:class_export_put()) final put ffff9650f6138800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788460528.295416:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6138800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788460528.295421:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788460528.295613:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2383800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788460528.295619:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c7cfa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788460528.295624:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c7cfe000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788460528.295628:0:38:0:(genops.c:885:class_export_put()) final put ffff9650fd26a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788460528.295630:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fd26a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788460528.295633:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788460528.295656:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c7cfd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788460528.295660:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc13c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788460528.295666:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc13c6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788460528.295678:0:38:0:(genops.c:885:class_export_put()) final put ffff964fc13c5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788460528.295680:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc13c5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788460528.295686:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788460528.295741:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6140800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788460528.295857:0:38:0:(genops.c:885:class_export_put()) final put ffff9650f6139000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788460528.295860:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6139000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788460528.295864:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788460528.296005:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6146000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788460528.296010:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d1056000/ce24ccd6-bef2-4d18-b934-4ac2305873bc for MGS 00000020:00000080:2.0:1788460528.296109:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650d1057000 for MGS 00000100:00100000:2.0:1788460528.296281:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9650d32e2200:5834] 0 exiting: rc = 1 00000100:00100000:3.0:1788460528.297906:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297918:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297925:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297931:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297936:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297942:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297948:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297954:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297960:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297970:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297976:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297980:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297988:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.297993:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298000:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298005:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298014:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298020:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298041:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298047:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298053:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298058:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298064:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298070:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298076:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298082:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298087:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298092:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298097:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298103:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298108:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298114:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298119:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298124:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298129:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298134:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298140:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298145:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298149:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298155:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298160:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298707:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298719:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298726:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298733:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298739:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298816:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298823:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298829:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298835:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298843:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298850:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298857:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298884:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298891:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298897:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298905:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298911:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298918:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298925:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298932:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298939:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298950:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.298960:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788460528.300068:0:13105:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788460528.300075:0:13105:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788460528.301851:0:13105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff964fc1b40540 - data ffff9650fcf9b0d8/ffff964fc3e99800 00000020:01000000:3.0:1788460528.301988:0:13105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650e8ab5c60 - data ffff9650c22d0bd0/ffff9650d08f7c00 00000020:00000080:3.0:1788460528.302609:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6e3d 00000020:00000080:3.0:1788460528.302616:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650d32fd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460528.302634:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d32fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1788460528.302646:0:13105:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650c5118800 from MGS, refs=2 00000020:01000004:3.0:1788460528.302650:0:13105:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c5118800 2 00000020:01000004:3.0:1788460528.302653:0:13105:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9650c5118800 from MGS 00000020:00000080:3.0:1788460528.302673:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460528.302679:0:13105:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788460528.302682:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650d32fe000/MGS 00000020:00000080:3.0:1788460528.302684:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d32fe000/MGS for MGS 00000020:01000000:3.0:1788460528.302689:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788460528.302742:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788460528.303092:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460528.303099:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788460528.303105:0:13105:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9650ea76c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460528.303110:0:13105:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9650d119cc98) has exports, disconnecting them 00000020:00080000:3.0:1788460528.303115:0:13105:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9650ea76c800), last request at 1788460305 00000020:00000080:3.0:1788460528.303135:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6f08 00000020:00080000:3.0:1788460528.303146:0:13105:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650ea76c800): rc 0 00000020:00000080:3.0:1788460528.303150:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650ea76c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788460528.303333:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650ea76c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788460528.305247:0:13105:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788460528.305255:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788460528.305259:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788460528.305265:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788460528.305445:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460528.305453:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788460528.305460:0:13105:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c5118800 1 00000020:00000080:2.0:1788460528.305465:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6e2f 00000020:00000080:2.0:1788460528.305472:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650d32f9800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788460528.305477:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788460528.305482:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460528.305485:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788460528.305487:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9650c3814c98) has no exports 00000020:00000080:0.0:1788460528.306968:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650ea76e000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788460528.306983:0:38:0:(genops.c:885:class_export_put()) final put ffff965101d82000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788460528.306986:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff965101d82000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788460528.306993:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788460528.307053:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d32f9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788460528.381729:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460528.381751:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788460528.381761:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650c5119000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788460528.381765:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c5119000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788460528.381775:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788460528.383195:0:13105:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff9650c511d800 00000020:01000000:2.0:1788460528.383234:0:13105:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788460528.383239:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460528.383244:0:13105:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788460528.383249:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9650d119b310) has no exports 00000100:00100000:2.0:1788460528.383330:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9650c34e6000:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1788460528.383585:0:7007:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9650ea72e000:7007] 3 exiting: rc = 0 00000100:00100000:0.0:1788460528.383837:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9650e6d68e00:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1788460528.383922:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9650d148dc00:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1788460528.384039:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384047:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384054:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384059:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384139:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384144:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384148:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384154:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384159:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384173:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384302:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384311:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384316:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384321:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384326:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384331:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384338:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384343:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384348:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384353:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384359:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384369:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384464:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384473:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384481:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384490:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384498:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384598:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384608:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384624:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384632:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384645:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384652:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384659:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384666:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384672:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384678:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384687:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384720:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384729:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384737:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384823:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.384836:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385000:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385009:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385014:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385019:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385026:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385031:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385036:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385041:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385046:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385051:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385056:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385150:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385159:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385163:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385169:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385174:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385690:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385697:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385700:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385705:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460528.385708:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.395033:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9650c3f9b400:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1788460528.395142:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9650c3f9b200:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1788460528.398688:0:12105:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9650e70c0600:12105] 2 exiting: rc = 0 00000100:00100000:3.0:1788460528.399142:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399152:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399157:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399164:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399170:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399175:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399294:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399301:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399306:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399311:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399317:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399323:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399332:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399338:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399344:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399350:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399357:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399365:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399371:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399440:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399451:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399459:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399467:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399473:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399480:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399487:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399494:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399502:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399617:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399635:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399640:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399646:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399650:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399656:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399660:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399665:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399670:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399674:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399679:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399683:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399688:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399692:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399697:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399701:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399706:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399711:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399716:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399724:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399729:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399735:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399741:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399814:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399822:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399827:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399832:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399836:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399841:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399846:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399851:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399857:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399862:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399880:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399887:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.399892:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.400674:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9650d0a49c00:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1788460528.401063:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9650c4edf000:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1788460528.401255:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401267:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401281:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401305:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401312:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401318:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401325:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401330:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401336:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401342:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401348:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401355:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401361:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401366:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.401373:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402102:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402115:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402121:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402127:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402134:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402141:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402148:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402158:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402163:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402169:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402175:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402276:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402296:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402303:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402309:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402315:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402320:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402326:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402332:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402338:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402356:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402362:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402368:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402373:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402399:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402406:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402411:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402417:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402422:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402427:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402432:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402437:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402442:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402448:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402454:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402461:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402482:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402489:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402494:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402595:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402606:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402612:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402618:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402624:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402630:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402635:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402641:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402647:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.402653:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.414631:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9650d0ae5800:5849] 0 exiting: rc = 1 00000100:00100000:2.0:1788460528.414825:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9650d0ae4000:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1788460528.414948:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414956:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414961:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414966:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414973:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414978:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414983:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414989:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.414994:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415000:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415005:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415010:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415015:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415020:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415025:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415030:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415035:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415055:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415059:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415065:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415070:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415074:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415080:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415086:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415091:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415096:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415101:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415107:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415112:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415117:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415123:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415128:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415133:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415139:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415145:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415150:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415155:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415160:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415165:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415172:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415491:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415571:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415581:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415586:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415591:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415596:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415602:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415608:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415612:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415617:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415621:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415627:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415641:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415645:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415649:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415654:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415658:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415663:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415668:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415673:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415677:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415681:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415686:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.415691:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.416175:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9650d0a49800:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1788460528.416367:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9650d0ae5200:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788460528.416416:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416422:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416428:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416433:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416438:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416444:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416449:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416453:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416458:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416463:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416469:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416474:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416479:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416485:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416489:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416494:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416498:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416574:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416582:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416586:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416591:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416596:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416611:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416616:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416621:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416626:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416630:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416635:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416640:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416645:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416649:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416654:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416658:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416663:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416668:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416673:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416677:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416682:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416687:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416692:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416697:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416701:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416706:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416710:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416715:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416720:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416726:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416731:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416735:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.416740:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419224:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419245:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419250:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419256:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419261:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419266:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419271:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419293:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419298:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419304:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419309:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419314:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419318:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.419324:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460528.420283:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9650d0ae5400:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1788460528.420459:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9650d0ae4400:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1788460528.420592:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420599:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420604:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420609:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420613:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420618:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420624:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420629:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420634:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420639:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420643:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420649:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420654:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420660:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420664:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420669:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420675:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420680:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420686:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420692:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420698:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420704:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420709:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420716:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420721:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420727:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420732:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420738:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420896:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420902:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420907:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420912:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420917:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420922:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420926:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420931:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420935:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420939:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420944:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420949:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420953:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420958:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420963:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420967:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420971:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420975:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420979:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420984:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420989:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420994:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.420998:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421003:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421008:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421013:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421017:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421022:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421027:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421031:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421036:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421041:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421045:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421050:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421054:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.421066:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422011:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9650c75fd800:5857] 2 exiting: rc = 0 00000100:00100000:2.0:1788460528.422150:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9650d0a49e00:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1788460528.422656:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9650d0a48800:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788460528.422906:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422913:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422919:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422925:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422930:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422936:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422942:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422947:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422952:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422958:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422964:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422969:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422974:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422979:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422985:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.422991:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423014:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423022:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423028:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423034:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423040:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423045:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423050:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423056:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423061:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423066:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423075:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423086:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423094:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423103:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423108:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423114:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423123:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423148:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423157:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423166:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423175:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423274:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423280:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423287:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423324:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423337:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423349:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423361:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423366:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423603:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423619:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423628:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423634:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423640:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423646:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423651:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423657:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423662:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423668:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423673:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423680:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423685:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423690:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423696:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423701:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423707:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423713:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460528.423718:0:13105:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788460528.429638:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460528.429651:0:13105:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788460528.429657:0:13105:0:(genops.c:885:class_export_put()) final put ffff9650c4fd4000/MDS_uuid 00000020:00000080:0.0:1788460528.429661:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c4fd4000/MDS_uuid for MDS 00000020:01000000:0.0:1788460528.429681:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788460528.429946:0:13105:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788460529.037376:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460530.062475:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788460531.043770:0:13259:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:0.0:1788460531.061349:0:13259:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788460531.061401:0:13259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.061416:0:13259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.061424:0:13259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.061431:0:13259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.061452:0:13259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788460531.061470:0:13259:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-client 10000000:01000000:0.0:1788460531.061475:0:13259:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788460531.061494:0:13259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460531.061498:0:13259:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788460531.061504:0:13259:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460531.061509:0:13259:0:(import.c:65:import_set_state_nolock()) ffff9650f5c62800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788460531.061513:0:13259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460531.061515:0:13259:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788460531.061518:0:13259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788460531.062523:0:13259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.062538:0:13259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.062558:0:13259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.062563:0:13259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.062693:0:13259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788460531.062707:0:13259:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-OST0000 00010000:00010000:0.0:1788460531.062713:0:13259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.062720:0:13259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.062735:0:13259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.062742:0:13259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063238:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788460531.063245:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063253:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5600 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460531.063257:0:7659:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063265:0:7659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460531.063271:0:7659:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460531.063276:0:7659:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460531.063279:0:7659:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788460531.063281:0:7659:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788460531.063335:0:7659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063341:0:7659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788460531.063410:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482608512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460531.063472:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460531.063541:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063550:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc5600/0x889bb893541b71d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063563:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460531.063567:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063572:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4800 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460531.063583:0:7659:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063590:0:7659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460531.063596:0:7659:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460531.063601:0:7659:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460531.063603:0:7659:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 00010000:00010000:3.0:1788460531.063615:0:7659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063619:0:7659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460531.063634:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063640:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4800/0x889bb893541b71e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063648:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460531.063650:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063656:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460531.063658:0:7659:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063664:0:7659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460531.063678:0:7659:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460531.063683:0:7659:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460531.063685:0:7659:0:(mgc_request.c:1249:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788460531.063696:0:7659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063701:0:7659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460531.063707:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.063714:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460531.063715:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460531.063717:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460531.063864:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460531.063914:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608512 00000100:00100000:1.0:1788460531.063921:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608512 00000100:00100000:1.0:1788460531.063957:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788460531.063965:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e88c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1875336482608512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788460531.063978:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460531 with bad export cookie 9843664353459138137 00010000:00010000:0.0:1788460531.068464:0:13259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460531.068480:0:13259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b70dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b70e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460531.068500:0:13259:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788460531.068560:0:13259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068569:0:13259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068594:0:13259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068600:0:13259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068614:0:13259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460531.068631:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460531.068636:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068643:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d800 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460531.068646:0:5830:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068654:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460531.068661:0:5830:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460531.068666:0:5830:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788460531.068669:0:5830:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 00010000:00010000:0.0:1788460531.068702:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068708:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460531.068747:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068764:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029d800/0x889bb893541b742c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b7433 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068773:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460531.068774:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460531.068776:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788460531.068790:0:13259:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear params 10000000:01000000:0.0:1788460531.068793:0:13259:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788460531.068808:0:13259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068815:0:13259:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068820:0:13259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068826:0:13259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460531.068847:0:13259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788460531.068917:0:13259:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-sptlrpc 10000000:01000000:0.0:1788460531.068920:0:13259:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788460531.068931:0:13259:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788460531.068949:0:13259:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788460531.068952:0:13259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788460531.068957:0:13259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460531.068963:0:13259:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788460531.068966:0:13259:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9650d1199988) has no exports 00000020:00080000:0.0:1788460531.068987:0:13259:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9650d1199988) has no exports 00000020:01000000:0.0:1788460531.072660:0:13259:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650d11be0c0 - data ffff9650fceeaaf8/ffff9650f5e45c00 00000020:01000000:0.0:1788460531.072823:0:13259:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650c7faad80 - data ffff9650dd6641b0/ffff964fc1de2400 00000100:00100000:2.0:1788460531.074747:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482608768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460531.074829:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460531.074907:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460531.074915:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482608640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460531.074939:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460531.074971:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482608896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460531.074992:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460531.075019:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608768 00000100:00100000:2.0:1788460531.075026:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608768 00000100:00100000:2.0:1788460531.075055:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608640 00000100:00100000:2.0:1788460531.075058:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608640 00000100:00100000:2.0:1788460531.075066:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482608896 00000100:00100000:2.0:1788460531.075068:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482608896 00000100:00100000:2.0:1788460531.075080:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460531.075087:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1875336482608768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460531.075093:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460531 with bad export cookie 9843664353459138137 00000100:00100000:2.0:1788460531.075141:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1875336482608768:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (311us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460531.075148:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460531.075165:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788460531.075170:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1875336482608640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460531.075174:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460531 with bad export cookie 9843664353459138137 00000100:00100000:2.0:1788460531.075219:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1875336482608640:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (279us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460531.075238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788460531.075251:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788460531.075256:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3316:x1875336482608896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460531.075260:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460531 with bad export cookie 9843664353459138137 00000100:00100000:2.0:1788460531.075290:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3316:x1875336482608896:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (297us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460531.075296:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788460531.075341:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import mgc192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788460531.075346:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9650d09a2800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788460531.075350:0:3319:0:(import.c:186:ptlrpc_set_import_discon()) mgc192.168.203.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788460531.075554:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460531.075562:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.075572:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4a00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460531.075576:0:7658:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.075585:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460531.075593:0:7658:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460531.075599:0:7658:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460531.075608:0:7658:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:3.0:1788460531.075611:0:7658:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00000100:00100000:1.0:1788460531.076381:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e88c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1875336482608512:12345-0@lo:103:ldlm_bl.0 Request processed in 12413us (12906us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788460531.076390:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788460531.076435:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import mgc192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788460531.087378:0:3319:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for mgc192.168.203.132@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788460531.087384:0:3319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788460531.087394:0:3319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efdd1880 x1875336482608512/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460547 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460531.087408:0:3319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efdd1c00 x1875336482608768/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460547 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460531.087418:0:3319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efdd0000 x1875336482608640/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460547 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460531.087427:0:3319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650f6054e00 x1875336482608896/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460547 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788460531.087436:0:3319:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788460531.087439:0:3319:0:(pinger.c:200:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788460531.087440:0:3319:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788460531.087546:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3316:1875336482608896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460531.087634:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.087644:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460531.087658:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.087665:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4a00/0x889bb893541b71ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b71f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460531.087681:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460531.087684:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460531.087686:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460531.087840:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460531.087902:0:3317:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9650d09a2800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788460531.087920:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:0:1875336482609024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460531.087925:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3317:1875336482608512:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788460531.087994:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9650d09a2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460531.088000:0:3319:0:(import.c:545:import_select_connection()) mgc192.168.203.132@tcp: connect to NID 0@lo last attempt 178 00000100:00080000:2.0:1788460531.088008:0:3319:0:(import.c:665:import_select_connection()) mgc192.168.203.132@tcp: import ffff9650d09a2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460531.088408:0:3319:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff965101d8f800 x1875336482609152/t0(0) o250->mgc192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460531.088451:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482608768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460531.088467:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3319:1875336482608640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460531.088533:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460531.089010:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3315:1875336482609152:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788460531.089055:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875336482609152 offset 0 length 520: 4 00100000:10000000:1.0:1788460531.097751:0:13259:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788460531.140460:0:13259:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6f7f 00000020:00000080:3.0:1788460531.140470:0:13259:0:(genops.c:885:class_export_put()) final put ffff9650efd4f800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788460531.140489:0:13259:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650f6139800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788460531.140493:0:13259:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650f6139800 2 00000020:01000004:3.0:1788460531.140496:0:13259:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9650f6139800 from lustre-OST0000 00000020:00000080:3.0:1788460531.140517:0:13259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460531.140527:0:13259:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788460531.140529:0:13259:0:(genops.c:885:class_export_put()) final put ffff9650efd4a800/lustre-OST0000_UUID 00000020:00000080:3.0:1788460531.140532:0:13259:0:(genops.c:844:class_export_destroy()) destroying export ffff9650efd4a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788460531.140538:0:13259:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788460531.140584:0:13259:0:(obd_mount.c:666:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788460531.140588:0:13259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788460531.140592:0:13259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460531.140596:0:13259:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788460531.140602:0:13259:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9650d0bf3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460531.140619:0:13259:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9650f5eb4c98) has exports, disconnecting them 00000020:00080000:3.0:1788460531.140624:0:13259:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9650d0bf3800), last request at 1788460322 00000020:00000080:3.0:1788460531.140628:0:13259:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6fb7 00000020:00080000:3.0:1788460531.140636:0:13259:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650d0bf3800): rc 0 00000020:00000080:3.0:1788460531.140641:0:13259:0:(genops.c:885:class_export_put()) final put ffff9650d0bf3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788460531.140829:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650efd4f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788460531.141018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d0bf3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788460531.142221:0:13259:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788460531.142227:0:13259:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460531.142232:0:13259:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788460531.142238:0:13259:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460531.142382:0:13259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460531.142389:0:13259:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788460531.142395:0:13259:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650f6139800 1 00000020:00000080:3.0:1788460531.142400:0:13259:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6f39 00000020:00000080:3.0:1788460531.142407:0:13259:0:(genops.c:885:class_export_put()) final put ffff9650f613e000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788460531.142411:0:13259:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788460531.142415:0:13259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460531.142418:0:13259:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788460531.142421:0:13259:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9650c3813310) has no exports 00000020:00000080:0.0:1788460531.142492:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650f5c62800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788460531.142500:0:37:0:(genops.c:885:class_export_put()) final put ffff9650d28b8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788460531.142502:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d28b8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788460531.142506:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788460531.142553:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f613e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788460531.152626:0:13259:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460531.152685:0:13259:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788460531.152690:0:13259:0:(genops.c:885:class_export_put()) final put ffff9650f613b000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788460531.152694:0:13259:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f613b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788460531.152700:0:13259:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788460531.152821:0:13259:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff9650f613d800 00000020:02000400:3.0:1788460531.152867:0:13259:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788460532.120658:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460533.132426:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460533.260846:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) ce24ccd6-bef2-4d18-b934-4ac2305873bc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460533.260856:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) ce24ccd6-bef2-4d18-b934-4ac2305873bc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460533.260859:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460533.260862:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788460533.260866:0:37:0:(import.c:65:import_set_state_nolock()) ffff9650fd26e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460533.260873:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 401 00000100:00080000:0.0:1788460533.260879:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788460533.260886:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9650fd26e000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460533.260921:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650f6054e00 x1875336482609280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460533.260973:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482609280:0@lo:38:kworker.0 00000400:00000100:2.0:1788460533.261019:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336482609280 offset 0 length 520: 4 00000020:01000004:2.0:1788460533.596169:0:13410:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:2.0:1788460533.603651:0:13410:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788460533.603736:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.603751:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.603759:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.603767:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.603790:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788460533.603807:0:13410:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-client 10000000:01000000:2.0:1788460533.603811:0:13410:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788460533.603844:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788460533.603855:0:13410:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650f6054e00 x1875336482609280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460548 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460533.603872:0:13410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788460533.603874:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460533.603882:0:7659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.603898:0:7659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460533.603907:0:7659:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.603916:0:7659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788460533.603916:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650fd26e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460533.603920:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 10000000:00010000:3.0:1788460533.603923:0:7659:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460533.603924:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482609280:0@lo:38:kworker.0 10000000:01000000:3.0:1788460533.603930:0:7659:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460533.603932:0:7659:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788460533.603934:0:7659:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1788460533.603949:0:13410:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788460533.603954:0:13410:0:(import.c:65:import_set_state_nolock()) ffff9650fd26e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788460533.603958:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788460533.603960:0:13410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788460533.603962:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788460533.603964:0:7659:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d09a2800 00010000:00010000:3.0:1788460533.603967:0:7659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.603975:0:7659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0031400/0x889bb893541b71a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b71af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.603986:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460533.603988:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460533.603989:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460533.604909:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.604921:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.604928:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.604935:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.604957:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788460533.604971:0:13410:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-OST0001 00010000:00010000:2.0:1788460533.604976:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.604982:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.604988:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605003:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605018:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788460533.605024:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605031:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605037:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605043:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605053:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788460533.605061:0:13410:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear params 00010000:00010000:2.0:1788460533.605066:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605072:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605078:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605084:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460533.605099:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788460533.605163:0:13410:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788460533.605166:0:13410:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788460533.605206:0:13410:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788460533.605210:0:13410:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788460533.605215:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460533.605220:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1788460533.605223:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:2.0:1788460533.605224:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9650f5cf6620) has no exports 00010000:00010000:3.0:1788460533.605228:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605235:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031600 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460533.605238:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788460533.605244:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9650f5cf6620) has no exports 00010000:00010000:3.0:1788460533.605246:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460533.605259:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460533.605265:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460533.605268:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 10000000:01000000:3.0:1788460533.605270:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788460533.605297:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d09a2800 00010000:00010000:3.0:1788460533.605300:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605307:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0031600/0x889bb893541b71b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b71bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605318:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788460533.605321:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605326:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460533.605329:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605336:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460533.605341:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460533.605346:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460533.605348:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:3.0:1788460533.605356:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788460533.605373:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d09a2800 00010000:00010000:3.0:1788460533.605376:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605383:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc4000/0x889bb893541b70c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b70c8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605395:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460533.605397:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605403:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460533.605405:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605412:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460533.605418:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460533.605423:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788460533.605425:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:3.0:1788460533.605426:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788460533.605440:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d09a2800 00010000:00010000:3.0:1788460533.605444:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605450:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c166f400/0x889bb893541b741e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b7425 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605470:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460533.605474:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605479:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460533.605494:0:5831:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605502:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460533.605507:0:5831:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460533.605512:0:5831:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460533.605514:0:5831:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:3.0:1788460533.605516:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788460533.605537:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d09a2800 00010000:00010000:3.0:1788460533.605540:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605545:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b71c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b71cb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460533.605554:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460533.605556:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460533.605558:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460533.605566:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460533.605571:0:7659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788460533.608038:0:13410:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650d11be840 - data ffff9650fceea1b0/ffff9650f5e46400 00010000:00010000:3.0:1788460533.609255:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788460533.610001:0:13410:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650fde2b6c0 - data ffff9650dd52f438/ffff9650fcd39800 00100000:10000000:2.0:1788460533.627238:0:13410:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788460533.653038:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7074 00000020:00000080:0.0:1788460533.653048:0:13410:0:(genops.c:885:class_export_put()) final put ffff9650f5cfa000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788460533.653073:0:13410:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650efb15800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788460533.653077:0:13410:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650efb15800 2 00000020:01000004:0.0:1788460533.653080:0:13410:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9650efb15800 from lustre-OST0001 00000020:00000080:0.0:1788460533.653102:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460533.653111:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788460533.653124:0:13410:0:(genops.c:885:class_export_put()) final put ffff964fc12d3000/lustre-OST0001_UUID 00000020:00000080:0.0:1788460533.653127:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc12d3000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788460533.653134:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788460533.653321:0:13410:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import ce24ccd6-bef2-4d18-b934-4ac2305873bc->MGS 00010000:00010000:3.0:1788460533.653337:0:13410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c0030c00/0x889bb893541b6f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b6f63 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460533.653348:0:13410:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c0030c00/0x889bb893541b6f5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b6f63 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460533.653354:0:13410:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788460533.653357:0:13410:0:(mgc_request.c:1259:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788460533.653360:0:13410:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788460533.653390:0:13410:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d09a2800 00010000:00010000:3.0:1788460533.653395:0:13410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c0030c00/0x889bb893541b6f5c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b6f63 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788460533.653415:0:13410:0:(import.c:65:import_set_state_nolock()) ffff9650d09a2800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788460533.653419:0:13410:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788460533.653421:0:13410:0:(pinger.c:200:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788460533.653423:0:13410:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788460533.653427:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788460533.653437:0:13410:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff965101d8f800 x1875336482609152/t0(0) o250->mgc192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788460541 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1788460533.653453:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5cfa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1788460533.653461:0:13410:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788460533.653464:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1788460533.653527:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ce24ccd6-bef2-4d18-b934-4ac2305873bc:3315:1875336482609152:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:3.0:1788460533.653607:0:13410:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788460533.653614:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b6e4b 00000020:00000080:3.0:1788460533.653619:0:13410:0:(genops.c:885:class_export_put()) final put ffff9650d09a7800/ce24ccd6-bef2-4d18-b934-4ac2305873bc 00000020:01000000:3.0:1788460533.653916:0:13410:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of mgc192.168.203.132@tcp (flags='') 00000020:00000080:3.0:1788460533.653923:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460533.653928:0:13410:0:(obd_config.c:956:class_cleanup()) mgc192.168.203.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788460533.653932:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9650d119e620) has no exports 00000020:00000080:2.0:1788460533.653977:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d09a7800/ce24ccd6-bef2-4d18-b934-4ac2305873bc for mgc192.168.203.132@tcp 10000000:01000000:0.0:1788460533.654350:0:5839:0:(mgc_request.c:989:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788460533.654432:0:13410:0:(obd_class.h:688:obd_cleanup_client_import()) mgc192.168.203.132@tcp: client import never connected 00000100:00080000:3.0:1788460533.654436:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788460533.654439:0:13410:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788460533.654441:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788460533.654442:0:13410:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788460533.654494:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460533.654500:0:13410:0:(obd_config.c:883:class_detach()) detach on obd mgc192.168.203.132@tcp (uuid ce24ccd6-bef2-4d18-b934-4ac2305873bc) 00000020:01000000:3.0:1788460533.654505:0:13410:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788460533.654509:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460533.654512:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788460533.654518:0:13410:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9650fd26f000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460533.654523:0:13410:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9650f5eb1988) has exports, disconnecting them 00000020:00080000:3.0:1788460533.654527:0:13410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9650fd26f000), last request at 1788460342 00000020:00000080:3.0:1788460533.654531:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b70ac 00000020:00080000:3.0:1788460533.654542:0:13410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650fd26f000): rc 0 00000020:00000080:3.0:1788460533.654546:0:13410:0:(genops.c:885:class_export_put()) final put ffff9650fd26f000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788460533.655473:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650d09a2800 for mgc192.168.203.132@tcp 00000020:00000080:2.0:1788460533.655482:0:38:0:(genops.c:885:class_export_put()) final put ffff9650c4fd3800/ce24ccd6-bef2-4d18-b934-4ac2305873bc 00000020:00000080:2.0:1788460533.655485:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c4fd3800/ce24ccd6-bef2-4d18-b934-4ac2305873bc for mgc192.168.203.132@tcp 00000020:01000000:2.0:1788460533.655490:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd mgc192.168.203.132@tcp (ce24ccd6-bef2-4d18-b934-4ac2305873bc) 00000020:00000080:2.0:1788460533.655750:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fd26f000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788460533.656226:0:13410:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788460533.656231:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788460533.656235:0:13410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788460533.656240:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788460533.656261:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fd26e000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788460533.658254:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788460533.661246:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788460533.663362:0:7659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788460533.663549:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788460533.663641:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9650e1c10200:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1788460533.663675:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9650e1c11000:5826] 1 exiting: rc = 0 00000100:00100000:0.0:1788460533.663711:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.663946:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9650ea576200:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1788460533.664418:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9650c4570600:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1788460533.664512:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9650d0831600:5829] 2 exiting: rc = 0 00000100:00100000:1.0:1788460533.664517:0:7669:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9650fd267800:7669] 3 exiting: rc = 0 00000100:00100000:0.0:1788460533.664692:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664702:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664708:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664714:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664721:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664726:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664732:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664737:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664743:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664748:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664754:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664763:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664769:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664774:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664780:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664786:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664793:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664798:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664804:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664810:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664815:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664820:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664825:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664839:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664845:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664858:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664864:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664869:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664874:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664880:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664886:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664891:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664896:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664901:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664906:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664910:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664915:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664919:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664924:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664929:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664934:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664939:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664944:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664948:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664953:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664958:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664963:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664967:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664971:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664977:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664981:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664985:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664990:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664994:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.664999:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665004:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665010:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665015:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665020:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665025:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665038:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665043:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665048:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.665053:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788460533.665732:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460533.665742:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788460533.665748:0:13410:0:(genops.c:885:class_export_put()) final put ffff9650ea76a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788460533.665752:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff9650ea76a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788460533.665758:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788460533.665796:0:13410:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650efb15800 1 00000020:00000080:0.0:1788460533.665802:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b7043 00000020:00000080:0.0:1788460533.665808:0:13410:0:(genops.c:885:class_export_put()) final put ffff9650d28bd800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788460533.665827:0:13410:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788460533.665840:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460533.665844:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788460533.665848:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff964fc2276620) has no exports 00000020:00000080:2.0:1788460533.665864:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d28bd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788460533.697440:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460533.697454:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788460533.697460:0:13410:0:(genops.c:885:class_export_put()) final put ffff9650c7cfb000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788460533.697465:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c7cfb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788460533.697474:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788460533.697668:0:13410:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff9650c7cfb800 00000020:01000000:3.0:1788460533.697688:0:13410:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788460533.697692:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460533.697696:0:13410:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788460533.697700:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9650f597e620) has no exports 00000020:00000080:2.0:1788460533.699449:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460533.699463:0:13410:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788460533.699468:0:13410:0:(genops.c:885:class_export_put()) final put ffff9650f613a800/OSS_uuid 00000020:00000080:2.0:1788460533.699472:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f613a800/OSS_uuid for OSS 00000020:01000000:2.0:1788460533.699777:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788460533.700895:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9650c3a56600:6701] 2 exiting: rc = 0 00000100:00100000:2.0:1788460533.700988:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9650e88a3800:6700] 1 exiting: rc = 0 00000100:00100000:2.0:1788460533.701042:0:12613:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9650f6040000:12613] 4 exiting: rc = 0 00000100:00100000:0.0:1788460533.701376:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9650e88a2600:6699] 0 exiting: rc = 1 00000100:00080000:1.0:1788460533.701536:0:5838:0:(pinger.c:555:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788460533.701640:0:8864:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9650c3f9a600:8864] 3 exiting: rc = 0 00000100:00100000:2.0:1788460533.701780:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701789:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701794:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701801:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701806:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701812:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701817:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701821:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701827:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701840:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701846:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701851:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701855:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701860:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701865:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701869:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701874:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701879:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701884:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701889:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701894:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701915:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701919:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701924:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701929:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701934:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701938:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701943:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701948:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701952:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701958:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701962:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701967:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701972:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701979:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701984:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701988:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701993:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.701997:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702002:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702006:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702012:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702017:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702023:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702028:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702033:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702038:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702043:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702048:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702053:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702062:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702067:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702072:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702077:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702082:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702087:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702101:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702108:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702113:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702118:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702123:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702128:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702133:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.702145:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.703254:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9650fdf8ba00:6704] 1 exiting: rc = 0 00000100:00100000:1.0:1788460533.703570:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9650fdf8ae00:6702] 0 exiting: rc = 1 00000100:00100000:2.0:1788460533.703684:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703693:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703698:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703703:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703777:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703785:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703791:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703796:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703801:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703807:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703812:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703817:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703822:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703827:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703840:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703846:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703851:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703856:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703860:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703865:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703870:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703875:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703880:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703885:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703890:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703896:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703901:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703918:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703923:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703928:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703933:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703940:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703944:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703948:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703953:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703959:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703964:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703969:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703973:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703978:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703984:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703989:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.703995:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704445:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704455:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704460:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704465:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704470:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704474:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704479:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704555:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704561:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704566:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704571:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704576:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704582:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704587:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704592:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704597:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704602:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704607:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704612:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704626:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460533.704631:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460533.706022:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9650fdf8ac00:6706] 1 exiting: rc = 0 00000100:00100000:0.0:1788460533.706451:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9650fdf8b400:6705] 0 exiting: rc = 1 00000100:00100000:1.0:1788460533.706815:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9650fdf8b600:6707] 2 exiting: rc = 0 00000100:00100000:0.0:1788460533.706921:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706928:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706933:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706937:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706942:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706948:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706954:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706959:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706965:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706970:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706976:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706981:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706986:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.706991:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707009:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707014:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707030:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707037:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707043:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707049:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707055:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707061:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707067:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707073:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707079:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707084:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707090:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707095:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707102:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707107:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707113:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707119:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707125:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707131:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707136:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707141:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707146:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707152:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707157:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707175:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707372:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707378:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707383:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707390:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707395:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707399:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707405:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707411:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707417:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707431:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707437:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707443:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707449:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707455:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707461:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707467:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707472:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707478:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707623:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707630:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707636:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707642:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707647:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.707653:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460533.712633:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9650fdf8bc00:6708] 0 exiting: rc = 1 00000100:00100000:0.0:1788460533.712812:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9650fdf8b800:6709] 1 exiting: rc = 0 00000100:00100000:0.0:1788460533.712882:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712889:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712895:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712899:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712905:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712910:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712915:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712921:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712926:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712931:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712936:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712941:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712946:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712952:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712957:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712963:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712968:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712974:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712979:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.712999:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713005:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713009:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713015:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713020:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713025:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713031:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713036:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713040:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713045:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713050:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713055:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713060:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713065:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713071:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713076:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713081:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713087:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713092:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713097:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713102:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713107:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713113:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713118:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713123:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713129:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713133:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713138:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713143:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713148:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713154:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713158:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713163:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713169:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713174:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713466:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713471:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713476:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713481:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713485:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713490:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713495:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713501:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713506:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.713519:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460533.715793:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9650fdf8b200:6711] 1 exiting: rc = 0 00000100:00100000:2.0:1788460533.716441:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9650fdf8a600:6710] 0 exiting: rc = 1 00000100:00100000:0.0:1788460533.716602:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716610:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716616:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716621:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716627:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716647:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716654:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716659:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716664:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716670:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716675:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716680:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716685:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716691:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716696:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716701:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716719:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716741:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716748:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716755:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716760:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716766:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716771:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716777:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716782:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716799:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716805:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716822:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716828:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716855:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716862:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716867:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716873:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716878:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716885:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716890:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716895:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716901:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716906:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716912:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716917:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716937:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716945:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716951:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716957:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716963:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716969:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716975:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716981:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716986:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716991:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.716997:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717002:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717021:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717027:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717033:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717038:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717044:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717049:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717054:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717067:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717073:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717080:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460533.717085:0:13410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788460533.734547:0:13410:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788460549.525472:0:14023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788460558.246445:0:14484:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:3.0:1788460558.246471:0:14484:0:(obd_mount.c:1014:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788460558.246595:0:14484:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9650c5014000 00000020:01000004:3.0:1788460558.246610:0:14484:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788460558.246618:0:14484:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788460558.246632:0:14484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9650f597b310) 00000020:00000080:3.0:1788460558.246645:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788460558.275715:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788460558.282717:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788460558.283168:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788460558.283372:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788460558.283747:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788460558.283823:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1788460558.283925:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788460558.284023:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1788460558.289360:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788460558.289852:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 513: rc = 0 00100000:10000000:2.0:1788460558.294030:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 457: rc = 0 00100000:10000000:2.0:1788460558.295373:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 457: rc = 0 00100000:10000000:2.0:1788460558.296838:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 651: rc = 0 00100000:10000000:2.0:1788460558.297081:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 651: rc = 0 00100000:10000000:2.0:1788460558.298977:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 651: rc = 0 00100000:10000000:2.0:1788460558.300867:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 651: rc = 0 00100000:10000000:2.0:1788460558.301778:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 651: rc = 0 00100000:10000000:2.0:1788460558.302049:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 651: rc = 0 00100000:10000000:3.0:1788460558.303686:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 651: rc = 0 00100000:10000000:3.0:1788460558.303967:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 651: rc = 0 00100000:10000000:3.0:1788460558.305435:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 651: rc = 0 00100000:10000000:3.0:1788460558.306153:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 651: rc = 0 00100000:10000000:3.0:1788460558.306823:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 651: rc = 0 00100000:10000000:3.0:1788460558.309004:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 651: rc = 0 00100000:10000000:3.0:1788460558.309628:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 289: rc = 0 00100000:10000000:3.0:1788460558.309884:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 289: rc = 0 00100000:10000000:3.0:1788460558.310136:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 289: rc = 0 00100000:10000000:3.0:1788460558.311199:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 289: rc = 0 00100000:10000000:3.0:1788460558.311472:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 289: rc = 0 00100000:10000000:3.0:1788460558.311975:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 289: rc = 0 00100000:10000000:3.0:1788460558.312893:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 289: rc = 0 00100000:10000000:3.0:1788460558.313737:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 289: rc = 0 00100000:10000000:3.0:1788460558.314008:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 289: rc = 0 00100000:10000000:3.0:1788460558.316161:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 289: rc = 0 00100000:10000000:3.0:1788460558.316504:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 289: rc = 0 00100000:10000000:3.0:1788460558.317532:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 289: rc = 0 00100000:10000000:3.0:1788460558.317893:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 289: rc = 0 00100000:10000000:3.0:1788460558.319407:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 289: rc = 0 00100000:10000000:3.0:1788460558.319843:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 289: rc = 0 00100000:10000000:3.0:1788460558.321148:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 289: rc = 0 00100000:10000000:3.0:1788460558.322430:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 289: rc = 0 00100000:10000000:3.0:1788460558.324222:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 289: rc = 0 00100000:10000000:3.0:1788460558.324509:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 289: rc = 0 00100000:10000000:3.0:1788460558.326157:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 289: rc = 0 00100000:10000000:3.0:1788460558.327325:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 289: rc = 0 00100000:10000000:3.0:1788460558.328383:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 289: rc = 0 00100000:10000000:3.0:1788460558.329412:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 289: rc = 0 00100000:10000000:3.0:1788460558.330009:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 289: rc = 0 00100000:10000000:3.0:1788460558.330959:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 289: rc = 0 00100000:10000000:3.0:1788460558.332392:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 289: rc = 0 00100000:10000000:3.0:1788460558.332810:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 289: rc = 0 00100000:10000000:3.0:1788460558.333057:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 289: rc = 0 00100000:10000000:3.0:1788460558.333360:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 289: rc = 0 00100000:10000000:0.0:1788460558.342053:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 289: rc = 0 00100000:10000000:0.0:1788460558.342994:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 289: rc = 0 00100000:10000000:1.0:1788460558.347031:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 289: rc = 0 00100000:10000000:1.0:1788460558.349735:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 771: rc = 0 00100000:10000000:1.0:1788460558.350713:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788460558.350889:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 458: rc = 0 00100000:10000000:1.0:1788460558.352814:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788460558.352945:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 458: rc = 0 00100000:10000000:1.0:1788460558.353332:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788460558.353410:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 458: rc = 0 00100000:10000000:1.0:1788460558.355225:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788460558.355319:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 461: rc = 0 00100000:10000000:1.0:1788460558.356294:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788460558.356380:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 461: rc = 0 00100000:10000000:1.0:1788460558.361216:0:14484:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788460558.361330:0:14484:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 461: rc = 0 00000020:00000080:1.0:1788460558.361820:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788460558.361827:0:14484:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788460558.361837:0:14484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b81c3 00000020:01000004:1.0:1788460558.361843:0:14484:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788460558.361849:0:14484:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788460558.361854:0:14484:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9650c5014000 from MGS 00000020:01000004:1.0:1788460558.361857:0:14484:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788460558.361867:0:14484:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff964fc2273310) 00000020:00000080:1.0:1788460558.361878:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788460558.361930:0:14484:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650c5014000 from MGS, refs=2 00080000:01000000:1.0:1788460558.361933:0:14484:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788460558.361938:0:14484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b81d1 00000100:00100000:1.0:1788460558.362025:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788460558.362156:0:14484:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788460558.362162:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788460558.363057:0:14484:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788460558.363067:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788460558.363872:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460558.364031:0:14484:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788460558.364037:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788460558.364770:0:14484:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788460558.364779:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788460558.365213:0:14484:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788460558.365221:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788460558.365836:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460558.365840:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460558.365841:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460558.366915:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460558.366928:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460558.366931:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460558.367597:0:14484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788460558.373631:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788460558.380985:0:14484:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788460558.381002:0:14484:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788460558.381005:0:14484:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788460558.383838:0:14493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788460558.384016:0:14484:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788460558.384753:0:14484:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788460558.386294:0:14484:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788460558.386608:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460558.386790:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788460558.386796:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788460558.390216:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788460558.390233:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788460558.391297:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788460558.391306:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788460558.392236:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788460558.392257:0:14484:0:(obd_mount.c:496:lustre_start_mgc()) Start MGC 'mgc192.168.203.132@tcp' 00000020:01000004:2.0:1788460558.392259:0:14484:0:(obd_mount.c:505:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788460558.392294:0:14484:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD mgc192.168.203.132@tcp (typ=mgc) 00000020:00000080:2.0:1788460558.392307:0:14484:0:(genops.c:413:class_newdev()) Allocate new device mgc192.168.203.132@tcp (ffff9650f5eb0000) 00000020:00000080:2.0:1788460558.392323:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788460558.392400:0:14484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650d0bf0800@mgc192.168.203.132@tcp: add connection 192.168.203.132@tcp at head 00000100:00080000:1.0:1788460558.392723:0:14498:0:(pinger.c:473:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1788460558.392759:0:14484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mgc192.168.203.132@tcp-0 is initialized 00000040:01000000:2.0:1788460558.392766:0:14484:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788460558.394233:0:14499:0:(mgc_request.c:900:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788460558.394279:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd mgc192.168.203.132@tcp (uuid 2de9e0bf-5e47-4625-abae-f266e65391be) 00000020:00000080:2.0:1788460558.394298:0:14484:0:(genops.c:1385:class_connect()) connect: client 2de9e0bf-5e47-4625-abae-f266e65391be, cookie 0x889bb893541b81df 00000100:00080000:2.0:1788460558.394309:0:14484:0:(import.c:545:import_select_connection()) mgc192.168.203.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460558.394315:0:14484:0:(import.c:665:import_select_connection()) mgc192.168.203.132@tcp: import ffff9650d0bf0800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460558.394347:0:14484:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff965101d8ea00 x1875336482609408/t0(0) o250->mgc192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460558.394373:0:14484:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import 2de9e0bf-5e47-4625-abae-f266e65391be->MGS 00000020:01000004:2.0:1788460558.394397:0:14484:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788460558.394402:0:14484:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788460558.394414:0:14484:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9650f5eb3310) 00000020:00000080:2.0:1788460558.394425:0:14484:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788460558.396647:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2de9e0bf-5e47-4625-abae-f266e65391be:3315:1875336482609408:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788460558.396729:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460558.396799:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482609408 00000100:00100000:3.0:1788460558.396806:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482609408 00000100:00100000:3.0:1788460558.396844:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460558.396852:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3315:x1875336482609408:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788460558.396877:0:14495:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from 2de9e0bf-5e47-4625-abae-f266e65391be@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:3.0:1788460558.396902:0:14495:0:(genops.c:1385:class_connect()) connect: client 2de9e0bf-5e47-4625-abae-f266e65391be, cookie 0x889bb893541b81ed 00000100:00080000:3.0:1788460558.397082:0:14495:0:(import.c:65:import_set_state_nolock()) ffff9650c5012000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460558.397141:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+5:3315:x1875336482609408:12345-0@lo:250:mount.lustre.0 Request processed in 288us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.397149:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460558.397219:0:3315:0:(client.c:3126:ptlrpc_free_committed()) mgc192.168.203.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788460558.397238:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) mgc192.168.203.132@tcp: connect to target with instance 0 00000100:00080000:3.0:1788460558.397245:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) mgc192.168.203.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788460558.397249:0:3315:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788460558.397252:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788460558.397254:0:3315:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788460558.397261:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788460558.397265:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2de9e0bf-5e47-4625-abae-f266e65391be:3315:1875336482609408:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788460558.412000:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460558.412389:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788460558.412395:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788460558.413554:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460558.413563:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788460558.414344:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788460558.414352:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788460558.415165:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460558.416431:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788460558.416468:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788460558.421503:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788460558.421515:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788460558.465493:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460558.465803:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788460558.465810:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788460558.467340:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788460558.467351:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788460558.467991:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460558.468418:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788460558.468423:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788460558.469154:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788460558.469163:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788460558.469807:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460558.470037:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788460558.470042:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788460558.470761:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788460558.470769:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788460558.473749:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460558.474033:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788460558.474040:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788460558.474912:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788460558.474920:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788460558.498166:0:14484:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460558.498414:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788460558.498420:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788460558.501162:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460558.501237:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788460558.505971:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460558.505984:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788460558.507396:0:14484:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788460558.507451:0:14484:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788460558.507456:0:14484:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788460558.507457:0:14484:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460558.507459:0:14484:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460558.507464:0:14484:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460558.507465:0:14484:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460558.507467:0:14484:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460558.507468:0:14484:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460558.507469:0:14484:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460558.507471:0:14484:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460558.507472:0:14484:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788460558.507475:0:14484:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788460558.507477:0:14484:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788460558.507478:0:14484:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460558.507479:0:14484:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460558.507480:0:14484:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460558.507481:0:14484:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460558.507482:0:14484:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460558.507483:0:14484:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460558.507483:0:14484:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460558.507484:0:14484:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460558.507485:0:14484:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788460558.507510:0:14484:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788460558.507893:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788460558.507962:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.508047:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460558.510465:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482609536 00000100:00100000:1.0:1788460558.510481:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482609536 00000100:00100000:1.0:1788460558.510730:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460558.510743:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+5:14484:x1875336482609536:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788460558.510808:0:14497:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788460558.510869:0:14497:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788460558.510874:0:14497:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788460558.511395:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788460558.513579:0:14497:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788460558.514604:0:14518:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788460558.514610:0:14518:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788460558.514613:0:14518:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788460558.514648:0:14518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788460558.514899:0:14497:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788460558.514911:0:14497:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788460558.520969:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+5:14484:x1875336482609536:12345-0@lo:253:mount.lustre.0 Request processed in 10221us (12997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460558.520983:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460558.521049:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609536:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788460558.521063:0:14484:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788460558.521132:0:14484:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460558.521135:0:14484:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460558.521137:0:14484:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460558.521138:0:14484:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460558.521139:0:14484:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460558.521141:0:14484:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460558.521142:0:14484:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460558.521144:0:14484:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460558.521146:0:14484:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460558.521295:0:14484:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788460558.521316:0:14484:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9650c5014000 from lustre-MDT0000 10000000:01000000:2.0:1788460558.521342:0:14484:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788460558.521356:0:14484:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788460558.521360:0:14484:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9650c5014000 10000000:01000000:2.0:1788460558.521365:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460558.521384:0:14484:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650c5014000 from 1 10000000:01000000:2.0:1788460558.521387:0:14484:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788460558.521421:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.521432:0:14484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.521442:0:14484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.521461:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460558.521497:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.521575:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.521673:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482609664 00000100:00100000:3.0:1788460558.521680:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482609664 00000100:00100000:3.0:1788460558.521715:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788460558.521724:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+5:14484:x1875336482609664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460558.521736:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460558.521750:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d000/0x889bb893541b81fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b81f4 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.521774:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d000/0x889bb893541b81fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b81f4 expref: 6 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.521785:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d000/0x889bb893541b81fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b81f4 expref: 6 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.521794:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d000, rc 0) 00000100:00100000:3.0:1788460558.521992:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+6:14484:x1875336482609664:12345-0@lo:101:mount.lustre.0 Request processed in 268us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.521998:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460558.522056:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460558.522144:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.522294:0:14484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.522328:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460558.522352:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.522378:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460558.522679:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482609792 00000100:00100000:1.0:1788460558.522688:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482609792 00000100:00100000:1.0:1788460558.522756:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460558.522764:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+6:14484:x1875336482609792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460558.523049:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+6:14484:x1875336482609792:12345-0@lo:501:mount.lustre.0 Request processed in 286us (695us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460558.523056:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460558.523128:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609792:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788460558.523142:0:14484:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788460558.523173:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.523203:0:14484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460558.523211:0:14484:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9650c5014000 10000000:01000000:2.0:1788460558.523217:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788460558.523234:0:14484:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9650c5014000 10000000:01000000:2.0:1788460558.523240:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788460558.523252:0:14484:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-barrier-ffff9650c5014000 from 1 10000000:01000000:2.0:1788460558.523254:0:14484:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788460558.523274:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.523282:0:14484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.523290:0:14484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.523303:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460558.523329:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.523532:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.523625:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482609920 00000100:00100000:3.0:1788460558.523630:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482609920 00000100:00100000:3.0:1788460558.523653:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460558.523669:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+6:14484:x1875336482609920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460558.523678:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460558.523696:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029c400/0x889bb893541b8209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8202 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.523713:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029c400/0x889bb893541b8209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8202 expref: 7 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.523722:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029c400/0x889bb893541b8209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8202 expref: 7 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.523729:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c400, rc 0) 00000100:00100000:3.0:1788460558.523765:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+7:14484:x1875336482609920:12345-0@lo:101:mount.lustre.0 Request processed in 106us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.523771:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460558.524305:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482609920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460558.524319:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.524327:0:14484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460558.524350:0:14484:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788460558.524369:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.524376:0:14484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460558.524384:0:14484:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788460558.524389:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460558.524413:0:14484:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9650c5014000 10000000:01000000:2.0:1788460558.524416:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788460558.524426:0:14484:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788460558.524429:0:14484:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788460558.524447:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.524455:0:14484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.524463:0:14484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.524478:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460558.524508:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.524715:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.524772:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482610048 00000100:00100000:3.0:1788460558.524778:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482610048 00000100:00100000:3.0:1788460558.524813:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460558.524829:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+7:14484:x1875336482610048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460558.524838:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460558.524849:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029c800/0x889bb893541b8217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8210 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.525404:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029c800/0x889bb893541b8217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8210 expref: 8 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.525417:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029c800/0x889bb893541b8217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8210 expref: 8 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.525425:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c800, rc 0) 00000100:00100000:3.0:1788460558.525487:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+8:14484:x1875336482610048:12345-0@lo:101:mount.lustre.0 Request processed in 666us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.525507:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460558.525616:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460558.525634:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.525652:0:14484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.525712:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460558.525756:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.525790:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460558.525961:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482610176 00000100:00100000:1.0:1788460558.526395:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482610176 00000100:00100000:1.0:1788460558.526491:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460558.526501:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+8:14484:x1875336482610176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460558.526866:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+9:14484:x1875336482610176:12345-0@lo:501:mount.lustre.0 Request processed in 367us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460558.526879:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788460558.526951:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460558.526984:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460558.527019:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460558.533394:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482610304 00000100:00100000:0.0:1788460558.533410:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482610304 00000100:00100000:0.0:1788460558.537428:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460558.537456:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+9:14484:x1875336482610304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460558.537889:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+9:14484:x1875336482610304:12345-0@lo:503:mount.lustre.0 Request processed in 446us (10868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460558.537897:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460558.538673:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460558.538700:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460558.547306:0:14519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14519:1875336482610432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460558.547394:0:14519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.547441:0:14519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460558.547562:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482610432 00000100:00100000:0.0:1788460558.547569:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482610432 00000100:00100000:0.0:1788460558.547617:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460558.547634:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+9:14519:x1875336482610432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460558.548048:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+9:14519:x1875336482610432:12345-0@lo:502:llog_process_th.0 Request processed in 405us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460558.548063:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460558.548460:0:14519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14519:1875336482610432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460558.548492:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460558.548504:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460558.548506:0:14519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788460558.548511:0:14519:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788460558.548513:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460558.548528:0:14519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9650f5eb6620) 00000020:00000080:2.0:1788460558.548544:0:14519:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788460558.548550:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788460558.548613:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788460558.548619:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b8225 00000020:00000080:2.0:1788460558.548843:0:14519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788460558.548849:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460558.548853:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460558.548855:0:14519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788460558.548857:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460558.548861:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460558.548862:0:14519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788460558.548866:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460558.548873:0:14519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9650f5eb1988) 00000020:00000080:2.0:1788460558.548884:0:14519:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788460558.548887:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788460558.548890:0:14519:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788460558.548892:0:14519:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788460558.548898:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788460558.548939:0:14519:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650c5014000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788460558.548950:0:14519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9650f5eb4c98) 00000020:00000080:2.0:1788460558.548957:0:14519:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788460558.548998:0:14519:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788460558.549003:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b823a 00000020:00000080:2.0:1788460558.550545:0:14519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788460558.550557:0:14519:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788460558.550567:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x889bb893541b8241 00080000:01000000:2.0:1788460558.550575:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788460558.550579:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b8248 00010000:00010000:1.0:1788460558.683516:0:14519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788460558.683951:0:14519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788460558.684125:0:14519:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788460558.688544:0:14519:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff964fc2274c98) 00000020:00000080:1.0:1788460558.688567:0:14519:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788460558.688683:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788460558.688690:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b8256 00000020:00000080:0.0:1788460558.691737:0:14519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788460558.716216:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x889bb893541b825d 00000020:00000080:0.0:1788460558.723441:0:14519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788460558.723456:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460558.723486:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.723488:0:14519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788460558.723492:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460558.723497:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.723499:0:14519:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788460558.723503:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788460558.723544:0:14519:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788460558.723559:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460558.723562:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.723564:0:14519:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788460558.723566:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788460558.723567:0:14519:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788460558.723569:0:14519:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788460558.723570:0:14519:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788460558.723572:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788460558.723573:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.723575:0:14519:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788460558.723577:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788460558.723580:0:14519:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788460558.723583:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.723584:0:14519:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788460558.723587:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788460558.723592:0:14519:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:0.0:1788460558.723615:0:14519:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788460558.723632:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788460558.723647:0:14519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9650f5cf6620) 00000020:00000080:0.0:1788460558.723676:0:14519:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788460558.723682:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788460558.723731:0:14519:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788460558.723736:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788460558.723742:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b826b 00010000:00080000:0.0:1788460558.723771:0:14519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650f5cff800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:0.0:1788460558.723989:0:14519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788460558.724471:0:14519:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788460558.724519:0:14519:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788460558.727751:0:14519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460558.727838:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788460558.727907:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788460558.728669:0:14523:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788460558.728674:0:14523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788460558.729473:0:14519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788460558.729484:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788460558.729517:0:14519:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788460558.729536:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b8272 00000100:00080000:1.0:1788460558.729546:0:14519:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460558.729552:0:14519:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9650f5cff800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460558.729586:0:14519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650ec01ed80 x1875336482610560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460558.729608:0:14519:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788460558.729699:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482610560:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788460558.729751:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482610560 offset 0 length 520: 4 00000020:01000000:1.0:1788460558.729910:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460558.729914:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.729916:0:14519:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788460558.729920:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788460558.729923:0:14519:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788460558.729925:0:14519:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460558.729926:0:14519:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460558.729928:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788460558.729931:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.729932:0:14519:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788460558.729934:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460558.729948:0:14519:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788460558.729952:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.729953:0:14519:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788460558.729956:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788460558.729960:0:14519:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:1.0:1788460558.729980:0:14519:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788460558.729983:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460558.729994:0:14519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff964fc2271988) 00000020:00000080:1.0:1788460558.730006:0:14519:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788460558.730011:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788460558.730073:0:14519:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788460558.730080:0:14519:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788460558.730085:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b8280 00010000:00080000:1.0:1788460558.730127:0:14519:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650f5cfa800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1788460558.730358:0:14519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788460558.730533:0:14519:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788460558.730554:0:14519:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788460558.731115:0:14519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460558.731206:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788460558.731277:0:14519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788460558.732117:0:14525:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788460558.732122:0:14525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788460558.732993:0:14519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460558.733004:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788460558.733031:0:14519:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788460558.733121:0:14519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b8287 00000100:00080000:0.0:1788460558.733134:0:14519:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788460558.733140:0:14519:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650f5cfa800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460558.733173:0:14519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650f6054e00 x1875336482610688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460558.733481:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482610688:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788460558.733530:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482610688 offset 0 length 520: 4 00000100:00080000:0.0:1788460558.733577:0:14519:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788460558.733627:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460558.733631:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.733632:0:14519:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788460558.733635:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460558.733645:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.733646:0:14519:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788460558.733649:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788460558.733651:0:14519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788460558.733653:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460558.733656:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.733668:0:14519:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788460558.733671:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460558.733673:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460558.733675:0:14519:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788460558.733678:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788460558.733704:0:14519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14519:1875336482610816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460558.733746:0:14519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460558.733765:0:14519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d297c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.733864:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482610816 00000100:00100000:3.0:1788460558.733872:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482610816 00000100:00100000:3.0:1788460558.733942:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460558.733950:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+9:14519:x1875336482610816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460558.734344:0:14519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14519:1875336482610816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460558.734372:0:14519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460558.734378:0:14519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460558.734379:0:14519:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788460558.734383:0:14519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:3.0:1788460558.734504:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+9:14519:x1875336482610816:12345-0@lo:502:llog_process_th.0 Request processed in 229us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.734512:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:3.0:1788460558.734674:0:14484:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788460558.734682:0:14484:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788460558.734729:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.734740:0:14484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460558.734747:0:14484:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5014000 from 1 10000000:01000000:3.0:1788460558.734751:0:14484:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460558.734778:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.734787:0:14484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.734796:0:14484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460558.734821:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460558.734847:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460558.734876:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fa540 going to sleep for 11 seconds 00000100:00100000:1.0:1788460558.734921:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482610944 00000100:00100000:1.0:1788460558.734925:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482610944 00000100:00100000:1.0:1788460558.734953:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460558.734960:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+9:14484:x1875336482610944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460558.734968:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460558.734984:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c29f4000/0x889bb893541b8295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b828e expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.735003:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c29f4000/0x889bb893541b8295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b828e expref: 10 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.735014:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c29f4000/0x889bb893541b8295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b828e expref: 10 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.735022:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4000, rc 0) 00000100:00100000:1.0:1788460558.735066:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482610944:12345-0@lo:101:mount.lustre.0 Request processed in 106us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460558.735072:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460558.735144:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482610944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460558.735155:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.735171:0:14484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.735753:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611072:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788460558.735791:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.735815:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06240 going to sleep for 11 seconds 00000100:00100000:1.0:1788460558.735921:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611072 00000100:00100000:1.0:1788460558.735926:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611072 00000100:00100000:1.0:1788460558.735960:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460558.735967:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482611072:12345-0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788460558.736009:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482611072:12345-0@lo:256:mount.lustre.0 Request processed in 43us (217us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788460558.736015:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788460558.736152:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611072:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788460558.736760:0:14484:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' failed (-11). 00010000:00010000:2.0:1788460558.736769:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.736779:0:14484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460558.736785:0:14484:0:(mgc_request.c:2375:mgc_process_log()) mgc192.168.203.132@tcp: IR log lustre-mdtir not ready yet: rc = -11 00010000:00010000:2.0:1788460558.736790:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.736798:0:14484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.736804:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.736811:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.736873:0:14484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460558.736995:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460558.737001:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.737008:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ce00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460558.737012:0:14491:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.737021:0:14491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460558.737035:0:14491:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460558.737053:0:14491:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460558.740823:0:14484:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5014000 from 1 10000000:01000000:2.0:1788460558.740834:0:14484:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460558.741045:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.741059:0:14484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.741072:0:14484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.741098:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460558.741165:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.741237:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06780 going to sleep for 11 seconds 00010000:00010000:1.0:1788460558.741857:0:14491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.741866:0:14491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788460558.741933:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482611328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460558.741972:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460558.742020:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.742029:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029ce00/0x889bb893541b828e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8295 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460558.742108:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460558.742110:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460558.742113:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460558.742169:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611200 00000100:00100000:3.0:1788460558.742194:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611200 00000100:00100000:3.0:1788460558.742239:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460558.742249:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482611200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460558.742261:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460558.742277:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b829c expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.742300:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b829c expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.742312:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b829c expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.742322:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d800, rc 0) 00000100:00100000:3.0:1788460558.742373:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482611200:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.742380:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788460558.742469:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611328 00000100:00100000:2.0:1788460558.742474:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611328 00000100:00100000:2.0:1788460558.742514:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460558.742521:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2de9e0bf-5e47-4625-abae-f266e65391be+11:3318:x1875336482611328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460558.742529:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788460558.742530:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460558.742540:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c29f4000/0x889bb893541b8295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b828e expref: 11 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460558.742543:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.742552:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460558.742552:0:14484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.742588:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2de9e0bf-5e47-4625-abae-f266e65391be+10:3318:x1875336482611328:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460558.742589:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6055180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460558.742594:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460558.742615:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460558.742635:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d297c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.742688:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611456 00000100:00100000:1.0:1788460558.742692:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482611328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460558.742693:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611456 00000100:00100000:3.0:1788460558.742711:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788460558.742718:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482611456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460558.743161:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482611456:12345-0@lo:501:mount.lustre.0 Request processed in 442us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.743175:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460558.743272:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6055180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460558.743309:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460558.743347:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460558.743455:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.743487:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611584 00000100:00100000:3.0:1788460558.743491:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611584 00000100:00100000:3.0:1788460558.743550:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788460558.743557:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482611584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460558.743713:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482611584:12345-0@lo:503:mount.lustre.0 Request processed in 156us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.743720:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460558.743812:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460558.744275:0:14527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14527:1875336482611712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460558.744314:0:14527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460558.744399:0:14527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4f80600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.744441:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611712 00000100:00100000:3.0:1788460558.744445:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611712 00000100:00100000:3.0:1788460558.744472:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788460558.744478:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14527:x1875336482611712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460558.744693:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14527:x1875336482611712:12345-0@lo:502:llog_process_th.0 Request processed in 214us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.744700:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460558.744865:0:14527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14527:1875336482611712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788460558.744888:0:14527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460558.744897:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.744900:0:14527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788460558.744912:0:14527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650c5014000 00000020:00000080:1.0:1788460558.744915:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460558.744923:0:14527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460558.744926:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.744927:0:14527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788460558.744930:0:14527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460558.744932:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.744933:0:14527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788460558.744937:0:14527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650c5014000 00000020:00000080:1.0:1788460558.744939:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460558.745026:0:14527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460558.745031:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.745032:0:14527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788460558.745035:0:14527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460558.745049:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.745050:0:14527:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460558.745055:0:14527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9650c5014000 00000020:00000080:1.0:1788460558.745057:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788460558.746743:0:14527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14527:1875336482611840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460558.746818:0:14527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460558.748260:0:14527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4f80600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.748803:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611840 00000100:00100000:3.0:1788460558.748813:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611840 00000100:00100000:3.0:1788460558.748909:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788460558.748920:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14527:x1875336482611840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460558.749422:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+10:14527:x1875336482611840:12345-0@lo:502:llog_process_th.0 Request processed in 503us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.749431:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460558.749540:0:14527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14527:1875336482611840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788460558.749572:0:14527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460558.749580:0:14527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460558.749583:0:14527:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788460558.749589:0:14527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788460558.749805:0:14484:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788460558.749816:0:14484:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460558.749863:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460558.749882:0:14484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460558.749926:0:14484:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788460558.749929:0:14484:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9650c5014000 10000000:01000000:0.0:1788460558.749932:0:14484:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9650c5014000 10000000:01000000:0.0:1788460558.749937:0:14484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460558.749954:0:14484:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650c5014000 from 1 10000000:01000000:0.0:1788460558.749957:0:14484:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788460558.749987:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460558.749996:0:14484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460558.750005:0:14484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460558.750024:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6055c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460558.750132:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460558.750168:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d297cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460558.750493:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482611968 00000100:00100000:2.0:1788460558.750500:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482611968 00000100:00100000:2.0:1788460558.750575:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460558.750584:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+10:14484:x1875336482611968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460558.750594:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460558.750606:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008a00/0x889bb893541b82b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b82aa expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.750631:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008a00/0x889bb893541b82b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b82aa expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.750641:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008a00/0x889bb893541b82b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b82aa expref: 11 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.750650:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008a00, rc 0) 00000100:00100000:2.0:1788460558.750703:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482611968:12345-0@lo:101:mount.lustre.0 Request processed in 120us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460558.750709:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788460558.750773:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6055c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482611968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460558.750788:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.750809:0:14484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460558.750845:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482612096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460558.750872:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460558.750955:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460558.751013:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612096 00000100:00100000:0.0:1788460558.751018:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612096 00000100:00100000:0.0:1788460558.751131:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788460558.751141:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482612096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460558.751395:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482612096:12345-0@lo:501:mount.lustre.0 Request processed in 255us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.751458:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482612096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460558.751487:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482612224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460558.751524:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460558.751533:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460558.751625:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612224 00000100:00100000:1.0:1788460558.751629:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612224 00000100:00100000:0.0:1788460558.756164:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460558.759884:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460558.759901:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482612224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460558.760328:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482612224:12345-0@lo:503:mount.lustre.0 Request processed in 433us (8802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460558.760342:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788460558.760992:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482612224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460558.762373:0:14532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14532:1875336482612352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460558.762439:0:14532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460558.762473:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612352 00000100:00100000:3.0:1788460558.762479:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612352 00000100:00100000:3.0:1788460558.762512:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788460558.762519:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:14532:x1875336482612352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460558.764252:0:14532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.764569:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:14532:x1875336482612352:12345-0@lo:502:llog_process_th.0 Request processed in 2047us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.764579:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788460558.764643:0:14532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14532:1875336482612352:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788460558.764721:0:14532:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788460558.764736:0:14532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9650f597cc98) 00000020:00000080:3.0:1788460558.764771:0:14532:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788460558.764858:0:14532:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650c5014000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788460558.764862:0:14532:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650c5014000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788460558.764865:0:14532:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c5014000 4 00010000:00080000:3.0:1788460558.764891:0:14532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650f6147000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1788460558.773424:0:14532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788460558.773626:0:14532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788460558.773676:0:14532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788460558.773691:0:14532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x889bb893541b82bf 00000100:00080000:3.0:1788460558.773701:0:14532:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788460558.773706:0:14532:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9650f6147000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1788460558.775318:0:14532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efdd0e00 x1875336482612480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460558.775353:0:14532:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788460558.775525:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482612480:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788460558.775599:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460558.775677:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612480 00000100:00100000:1.0:1788460558.775685:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612480 00000100:00100000:1.0:1788460558.775720:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460558.775727:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482612480:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788460558.775857:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482612480:12345-0@lo:38:llog_process_th.0 Request processed in 128us (258us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788460558.775866:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460558.775901:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788460558.775908:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f6147000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460558.775912:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788460558.775916:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482612480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460558.776987:0:14532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14532:1875336482612608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460558.777160:0:14532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788460558.777254:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460558.777258:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460558.777261:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460558.777264:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788460558.777281:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460558.777294:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482612736:0@lo:400:kworker.0 00000100:00100000:1.0:1788460558.777321:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460558.777838:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612608 00000100:00100000:3.0:1788460558.777845:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612608 00000100:00100000:3.0:1788460558.777878:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612736 00000100:00100000:3.0:1788460558.777880:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612736 00000100:00100000:3.0:1788460558.777890:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788460558.777897:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+12:14532:x1875336482612608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460558.778909:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+12:14532:x1875336482612608:12345-0@lo:502:llog_process_th.0 Request processed in 1007us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.778919:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788460558.778956:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788460558.778963:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:3318:x1875336482612736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460558.779009:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:3318:x1875336482612736:12345-0@lo:400:kworker.0 Request processed in 47us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460558.779016:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460558.780432:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482612736:0@lo:400:kworker.0 00000100:00100000:3.0:1788460558.784204:0:14532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.784247:0:14532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2de9e0bf-5e47-4625-abae-f266e65391be:14532:1875336482612608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788460558.784288:0:14532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788460558.784354:0:14484:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788460558.784362:0:14484:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788460558.784375:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460558.784386:0:14484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788460558.784442:0:14484:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788460558.784444:0:14484:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460558.784446:0:14484:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460558.784447:0:14484:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460558.784449:0:14484:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460558.784450:0:14484:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460558.784451:0:14484:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460558.784452:0:14484:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460558.784454:0:14484:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460558.784455:0:14484:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788460558.784459:0:14484:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788460558.784461:0:14484:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460558.784462:0:14484:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460558.784463:0:14484:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460558.784464:0:14484:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460558.784465:0:14484:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460558.784466:0:14484:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460558.784467:0:14484:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460558.784468:0:14484:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460558.784474:0:14484:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460558.784475:0:14484:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788460558.784494:0:14484:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788460558.784510:0:14484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482612864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788460558.784568:0:14484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460558.784591:0:14484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d9126240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460558.784617:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612864 00000100:00100000:3.0:1788460558.784622:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612864 00000100:00100000:3.0:1788460558.784670:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788460558.784678:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482612864:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788460558.784702:0:14497:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788460558.784714:0:14497:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788460558.860827:0:14497:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788460558.860870:0:14497:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788460558.865970:0:14517:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788460558.865981:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788460558.866006:0:14517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866023:0:14517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788460558.866321:0:14517:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000340980s 00010000:00010000:2.0:1788460558.866327:0:14517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866334:0:14517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866341:0:14517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866348:0:14517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866354:0:14517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460558.866359:0:14517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866367:0:14517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866381:0:14517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866388:0:14517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460558.866395:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008e00/0x889bb893541b82c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460558.871509:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+11:14484:x1875336482612864:12345-0@lo:253:mount.lustre.0 Request processed in 86823us (86932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460558.871555:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788460558.871779:0:14484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:14484:1875336482612864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788460558.871797:0:14484:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788460558.871800:0:14484:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788460558.871802:0:14484:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460558.871803:0:14484:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460558.871804:0:14484:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460558.871806:0:14484:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460558.871807:0:14484:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460558.871809:0:14484:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460558.871810:0:14484:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460558.871812:0:14484:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460558.871814:0:14484:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788460558.871828:0:14484:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788460558.884822:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460558.885076:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460558.888476:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460558.889262:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460558.892195:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460558.892479:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788460558.893913:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460558.894099:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788460558.894429:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460558.894677:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788460558.894948:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460558.895111:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788460558.962340:0:14484:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788460558.966131:0:14484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788460558.966291:0:14539:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788460558.966296:0:14539:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788460558.968580:0:14540:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788460558.968716:0:14540:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460558.970786:0:14540:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788460558.970870:0:14540:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788460558.970874:0:14540:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788460558.975936:0:14484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788460558.980015:0:14484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788460558.980564:0:14484:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788460558.980578:0:14484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788460558.980883:0:14484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460558.982167:0:14484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788460558.982801:0:14484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788460558.982831:0:14484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788460558.989310:0:14484:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788460559.000040:0:14484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788460559.086512:0:14484:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788460559.086561:0:14484:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa77dc1cc79b8 00100000:10000000:3.0:1788460559.086568:0:14484:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788460559.093837:0:14484:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788460559.093856:0:14484:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788460559.374691:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460559.820857:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788460560.012251:0:14499:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460560.012259:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5014000 from 1 10000000:01000000:3.0:1788460560.012264:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460560.012306:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460560.012320:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460560.012331:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460560.012355:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482612992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460560.012416:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460560.012464:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788460560.012522:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482612992 00000100:00100000:0.0:1788460560.012530:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482612992 00000100:00100000:0.0:1788460560.012583:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460560.012592:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+11:14499:x1875336482612992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460560.012605:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460560.012620:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b82cd expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460560.012641:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b82cd expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460560.012664:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b82cd expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460560.012674:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5be00, rc 0) 00000100:00100000:0.0:1788460560.012722:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482612992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460560.012729:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788460560.012814:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482612992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460560.012830:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460560.012839:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460560.013435:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482613120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788460560.013477:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460560.013509:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788460560.013624:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482613120 00000100:00100000:3.0:1788460560.013630:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482613120 00000100:00100000:3.0:1788460560.013675:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788460560.013691:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482613120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460560.013707:0:14495:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788460560.013722:0:14495:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460560.013725:0:14495:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788460560.013821:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482613120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460560.013828:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788460560.013863:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482613120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788460560.014499:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460560.014509:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460560.014520:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460560.407416:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460560.844895:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788460561.422859:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460562.444435:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460563.468431:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460563.981913:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460563.981921:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460563.981923:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460563.981927:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460563.981929:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788460563.981933:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788460563.981951:0:36:0:(import.c:65:import_set_state_nolock()) ffff9650f6147000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460563.981963:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9650f6147000 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460563.981988:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650f6054000 x1875336482613376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788460563.982035:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460563.982476:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482613248:0@lo:400:kworker.0 00000100:00100000:0.0:1788460563.982547:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460563.983438:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482613376:0@lo:38:kworker.0 00000100:00100000:0.0:1788460563.983479:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460563.983712:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482613376 00000100:00100000:3.0:1788460563.983720:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482613376 00000100:00100000:3.0:1788460563.983766:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788460563.983774:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1875336482613376:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788460563.983799:0:14503:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:3.0:1788460563.983837:0:14503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x889bb893541b82db 00000004:00100000:3.0:1788460563.983851:0:14503:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788460563.983987:0:14503:0:(import.c:65:import_set_state_nolock()) ffff964fc2c5f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460563.984044:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875336482613376:12345-0@lo:38:kworker.0 Request processed in 270us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460563.984052:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788460563.986351:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650f6054000 x1875336482613376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788460563.986375:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788460563.986392:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788460563.986397:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788460563.986400:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f6147000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788460563.986407:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482613376:0@lo:38:kworker.0 00000100:00100000:2.0:1788460563.987379:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482613248 00000100:00100000:2.0:1788460563.987845:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482613248 00000100:00100000:2.0:1788460563.987963:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788460563.987975:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+12:3317:x1875336482613248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460563.988087:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+12:3317:x1875336482613248:12345-0@lo:400:kworker.0 Request processed in 115us (5540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460563.988095:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460563.988172:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482613248:0@lo:400:kworker.0 00000001:02000400:1.0:1788460564.090879:0:14783:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788460564.494844:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460565.525949:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460566.540372:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788460567.495407:0:14934:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfaa1c530 20000000:00000080:2.0:1788460567.495424:0:14934:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9650ed402000 uarg=0000000000000000 20000000:01000000:2.0:1788460567.495455:0:14934:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788460567.495461:0:14934:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788460567.495465:0:14934:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788460567.496994:0:14935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788460567.497300:0:14934:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788460567.508829:0:14934:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788460567.509130:0:14934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460567.509149:0:14934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b829c expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460567.509157:0:14934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460567.509982:0:14934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b829c expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460567.510016:0:14934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b829c expref: 11 pid: 14495 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460567.510093:0:14934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14934:1875336482613504:0@lo:104: 00000100:00100000:0.0:1788460567.510153:0:14934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460567.510268:0:14934:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460567.510631:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482613504 00000100:00100000:3.0:1788460567.510639:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482613504 00000100:00100000:3.0:1788460567.510682:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460567.510689:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+3:14934:x1875336482613504:12345-0@lo:104: 00010000:00010000:3.0:1788460567.510702:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460567.510852:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788460567.510858:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+3:14934:x1875336482613504:12345-0@lo:104: Request processed in 170us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460567.510865:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788460567.510912:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460567.510919:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.510927:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460567.510931:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.510939:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460567.510946:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460567.510952:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460567.510984:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.510991:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460567.511008:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511014:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b829c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82a3 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511086:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460567.511088:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460567.511089:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460567.511107:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482613632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460567.511137:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460567.511199:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482613632 00000100:00100000:1.0:1788460567.511203:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482613632 00010000:00010000:1.0:1788460567.511222:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b829c expref: 12 pid: 14495 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460567.511244:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460567.511251:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+12:3317:x1875336482613632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460567.511260:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460567.511265:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b829c expref: 12 pid: 14495 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511276:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b829c expref: 12 pid: 14495 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511291:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511300:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511313:0:14488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511320:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511327:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511416:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511422:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460567.511426:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511433:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511442:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.511451:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460567.511693:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+12:3317:x1875336482613632:12345-0@lo:103:ldlm_bl.0 Request processed in 442us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460567.511700:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460567.511733:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482613632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460567.511947:0:14934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d800/0x889bb893541b82a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b829c expref: 11 pid: 14495 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460567.511959:0:14934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14934:1875336482613504:0@lo:104: 00010000:00010000:2.0:1788460567.511973:0:14934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.512096:0:14934:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.512104:0:14934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460567.512109:0:14934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650fcd5b000/0x889bb893541b82e2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460567.564317:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460568.076297:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460558/real 1788460558] req@ffff9650f6054e00 x1875336482610688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460568.076329:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650f6054e00 x1875336482610688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460568.076340:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460558/real 1788460558] req@ffff9650ec01ed80 x1875336482610560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460568.076352:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650ec01ed80 x1875336482610560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788460568.076372:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460568.076389:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460568.076393:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482610688:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788460568.076398:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460568.076413:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460568.076417:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482610560:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788460568.076918:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482613760:0@lo:400:kworker.0 00000100:00100000:3.0:1788460568.076986:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460568.077081:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482613760 00000100:00100000:0.0:1788460568.077090:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482613760 00000100:00100000:0.0:1788460568.077134:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788460568.077157:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+11:3318:x1875336482613760:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788460568.077958:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460568.077975:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788460568.077978:0:38:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460568.077983:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1788460568.077988:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788460568.077994:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9650f5cff800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460568.078020:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650ec01ed80 x1875336482613888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460568.078039:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460568.078042:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788460568.078044:0:38:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460568.078047:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1788460568.078050:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788460568.078053:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650f5cfa800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460568.078065:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650ec01df80 x1875336482614016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788460568.092206:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+11:3318:x1875336482613760:12345-0@lo:400:kworker.0 Request processed in 15038us (15207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460568.092223:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788460568.102296:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482613760:0@lo:400:kworker.0 00000100:00100000:3.0:1788460568.102326:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460568.102340:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482614144:0@lo:400:kworker.0 00000100:00100000:3.0:1788460568.102582:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460568.105953:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482613888:0@lo:8:kworker.0 00000400:00000100:1.0:1788460568.106029:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482613888 offset 0 length 520: 4 00000100:00100000:1.0:1788460568.106073:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482614016:0@lo:8:kworker.0 00000400:00000100:1.0:1788460568.106090:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482614016 offset 0 length 520: 4 00000100:00100000:3.0:1788460568.109374:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482614144 00000100:00100000:3.0:1788460568.109388:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482614144 00000100:00100000:3.0:1788460568.109445:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460568.109454:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482614144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460568.109536:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482614144:12345-0@lo:400:kworker.0 Request processed in 83us (6955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460568.109543:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788460568.109582:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650ec01d880 x1875336482614144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460568.109628:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482614144:0@lo:400:kworker.0 00010000:00010000:1.0:1788460568.589281:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788460568.785415:0:14499:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460568.785422:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5014000 from 10 10000000:01000000:1.0:1788460568.785427:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460568.785471:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460568.785501:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460568.785514:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460568.785542:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482614272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460568.785620:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460568.785671:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460568.785674:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482614272 00000100:00100000:3.0:1788460568.785682:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482614272 00000100:00100000:3.0:1788460568.785738:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788460568.785747:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+11:14499:x1875336482614272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460568.785762:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460568.785784:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b82e9 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460568.785807:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b82e9 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460568.785818:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b82e9 expref: 12 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460568.785827:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460568.785879:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482614272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460568.785886:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788460568.787142:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482614272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460568.787165:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460568.787177:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460568.787247:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482614400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460568.787291:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460568.787322:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460568.787434:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482614400 00000100:00100000:2.0:1788460568.787453:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482614400 00000100:00100000:2.0:1788460568.787500:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460568.787508:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482614400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460568.787754:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482614400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460568.787761:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788460568.787866:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482614400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460568.787899:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482614528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460568.787939:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460568.787965:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14c99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460568.790272:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482614528 00000100:00100000:2.0:1788460568.790287:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482614528 00000100:00100000:2.0:1788460568.790345:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460568.790356:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482614528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460568.790586:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+12:14499:x1875336482614528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460568.790605:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788460568.790695:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482614528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788460568.791516:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788460568.791981:0:14499:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788460568.791990:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460568.791999:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460568.792011:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460569.613105:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460570.064117:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788460570.636643:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460571.663556:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460572.685004:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788460572.950894:0:15183:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:3.0:1788460572.950898:0:15183:0:(obd_mount.c:1014:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788460572.951204:0:15183:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff964fc19a9000 00000020:01000004:3.0:1788460572.951229:0:15183:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788460572.951241:0:15183:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788460572.951254:0:15183:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9650f5979988) 00000020:00000080:3.0:1788460572.951269:0:15183:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788460572.971394:0:15183:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788460572.971713:0:15183:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788460572.972603:0:15183:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788460572.972823:0:15183:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788460572.973026:0:15183:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788460572.973421:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788460572.973554:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788460572.973669:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788460572.974170:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 239: rc = 0 00100000:10000000:3.0:1788460572.974458:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 239: rc = 0 00100000:10000000:3.0:1788460572.975433:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 239: rc = 0 00100000:10000000:3.0:1788460572.975704:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 239: rc = 0 00100000:10000000:3.0:1788460572.975969:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 239: rc = 0 00100000:10000000:3.0:1788460572.976387:0:15183:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 239: rc = 0 00000020:00000080:3.0:1788460572.976967:0:15183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788460572.976978:0:15183:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788460572.976989:0:15183:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x889bb893541b82fe 00000020:01000004:3.0:1788460572.976996:0:15183:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788460572.977017:0:15183:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788460572.977020:0:15183:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788460572.977025:0:15183:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788460572.977029:0:15183:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788460572.977040:0:15183:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9650f5978000) 00000020:00000080:3.0:1788460572.977263:0:15183:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788460572.978935:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460572.980348:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788460572.980354:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788460572.982741:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788460572.982755:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788460572.993588:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788460572.993602:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788460572.996603:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460572.996914:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788460572.996922:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788460572.998810:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788460572.998822:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788460573.021254:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460573.021751:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788460573.021758:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788460573.023657:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460573.023670:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788460573.024569:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460573.024578:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788460573.027375:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460573.027590:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788460573.027597:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788460573.028431:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788460573.028439:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788460573.091654:0:15183:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460573.092813:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788460573.092824:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788460573.097566:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788460573.097582:0:15183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788460573.098320:0:15183:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788460573.098366:0:15183:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788460573.098371:0:15183:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788460573.098373:0:15183:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788460573.098374:0:15183:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460573.098375:0:15183:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460573.098377:0:15183:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460573.098378:0:15183:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460573.098379:0:15183:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460573.098381:0:15183:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460573.098383:0:15183:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460573.098386:0:15183:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788460573.098389:0:15183:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460573.098390:0:15183:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788460573.098391:0:15183:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460573.098398:0:15183:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460573.098399:0:15183:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460573.098400:0:15183:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460573.098401:0:15183:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460573.098402:0:15183:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460573.098402:0:15183:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460573.098509:0:15183:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788460573.098529:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482614656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788460573.098606:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460573.098656:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c2bb53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460573.098878:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482614656 00000100:00100000:1.0:1788460573.098886:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482614656 00000100:00100000:1.0:1788460573.098962:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788460573.098972:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+12:15183:x1875336482614656:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788460573.099011:0:14496:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788460573.099014:0:14496:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788460573.099018:0:14496:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788460573.111703:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+12:15183:x1875336482614656:12345-0@lo:253:mount.lustre.0 Request processed in 12724us (13088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460573.111718:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788460573.111920:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482614656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788460573.111935:0:15183:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788460573.111938:0:15183:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788460573.111940:0:15183:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788460573.111941:0:15183:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460573.111942:0:15183:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460573.111944:0:15183:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460573.111945:0:15183:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460573.111947:0:15183:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460573.111948:0:15183:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460573.111950:0:15183:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788460573.111969:0:15183:0:(tgt_mount.c:115:server_register_mount()) register mount ffff964fc19a9000 from lustre-OST0000 10000000:01000000:3.0:1788460573.111994:0:15183:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788460573.111997:0:15183:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788460573.112002:0:15183:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff964fc19a9000 10000000:01000000:3.0:1788460573.112008:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460573.112021:0:15183:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460573.135812:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460573.147228:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460573.147244:0:15183:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff964fc19a9000 from 1 10000000:01000000:0.0:1788460573.147247:0:15183:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788460573.147297:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.147309:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.147320:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.147343:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482614784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460573.147407:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.147462:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c50363c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.147524:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482614784 00000100:00100000:3.0:1788460573.147532:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482614784 00000100:00100000:3.0:1788460573.147647:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460573.147657:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+12:15183:x1875336482614784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460573.147670:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460573.147682:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029dc00/0x889bb893541b8313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b830c expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.147712:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029dc00/0x889bb893541b8313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b830c expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.147722:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029dc00/0x889bb893541b8313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b830c expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.147742:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029dc00, rc 0) 00000100:00100000:3.0:1788460573.147790:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+13:15183:x1875336482614784:12345-0@lo:101:mount.lustre.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.147798:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788460573.147870:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482614784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460573.147884:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.147892:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.148380:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482614912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460573.148456:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.153962:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c50363c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460573.156228:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482614912 00000100:00100000:2.0:1788460573.156244:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482614912 00000100:00100000:2.0:1788460573.156305:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788460573.156329:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+13:15183:x1875336482614912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460573.158526:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+13:15183:x1875336482614912:12345-0@lo:501:mount.lustre.0 Request processed in 2191us (10060us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460573.158540:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788460573.163955:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482614912:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788460573.164547:0:15183:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788460573.164907:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460573.164959:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460573.165005:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea59b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460573.166393:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615040 00000100:00100000:1.0:1788460573.166408:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615040 00000100:00100000:1.0:1788460573.166479:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788460573.166489:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+13:15183:x1875336482615040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460573.166754:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+13:15183:x1875336482615040:12345-0@lo:501:mount.lustre.0 Request processed in 266us (1792us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460573.166762:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788460573.166809:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615040:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788460573.166926:0:15183:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788460573.166949:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.166961:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460573.166972:0:15183:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff964fc19a9000 10000000:01000000:0.0:1788460573.166980:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788460573.167003:0:15183:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460573.167118:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460573.167126:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460573.167133:0:15183:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff9650f5eb0000 10000000:01000000:0.0:1788460573.167137:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788460573.167152:0:15183:0:(mgc_request.c:2266:mgc_process_log()) Process log nodemap-ffff9650f5eb0000 from 1 10000000:01000000:0.0:1788460573.167155:0:15183:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788460573.167215:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.167224:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.167248:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.167270:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460573.167306:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.167333:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c50360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.167510:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615168 00000100:00100000:3.0:1788460573.167516:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615168 00000100:00100000:3.0:1788460573.167554:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460573.167570:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+13:15183:x1875336482615168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460573.167580:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460573.167592:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d600/0x889bb893541b8321 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b831a expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.167612:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d600/0x889bb893541b8321 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b831a expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.167623:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d600/0x889bb893541b8321 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b831a expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.167631:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d600, rc 0) 00000100:00100000:3.0:1788460573.167672:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+14:15183:x1875336482615168:12345-0@lo:101:mount.lustre.0 Request processed in 111us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.167686:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788460573.168004:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460573.168018:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8321 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.168027:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8321 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460573.168056:0:15183:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788460573.168071:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8321 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.168078:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8321 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460573.168084:0:15183:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788460573.168090:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460573.168119:0:15183:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460573.168219:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460573.168225:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460573.168233:0:15183:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff964fc19a9000 10000000:01000000:0.0:1788460573.168246:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788460573.168265:0:15183:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788460573.168267:0:15183:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788460573.168285:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.168293:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.168300:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.168314:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460573.168344:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.168367:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.168532:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615296 00000100:00100000:3.0:1788460573.168538:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615296 00000100:00100000:3.0:1788460573.168584:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788460573.168592:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+14:15183:x1875336482615296:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460573.168601:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460573.168610:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029da00/0x889bb893541b832f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8328 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.168624:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029da00/0x889bb893541b832f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8328 expref: 15 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.168632:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029da00/0x889bb893541b832f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8328 expref: 15 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.168637:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029da00, rc 0) 00000100:00100000:3.0:1788460573.168665:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615296:12345-0@lo:101:mount.lustre.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.168670:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788460573.168780:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460573.168792:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.168800:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460573.169730:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:1.0:1788460573.173337:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460573.174729:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:1.0:1788460573.175622:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 128 off8544 00000040:00080000:1.0:1788460573.175730:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 112 off8656 00000040:00080000:1.0:1788460573.175807:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8880 00000040:00080000:1.0:1788460573.175847:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9104 00000040:00080000:1.0:1788460573.175884:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 80 off9184 00000040:00080000:1.0:1788460573.175954:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9408 00000040:00080000:1.0:1788460573.175994:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9632 00000040:00080000:1.0:1788460573.176029:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 80 off9712 00000040:00080000:1.0:1788460573.176076:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off9936 00000040:00080000:1.0:1788460573.176112:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10160 00000040:00080000:1.0:1788460573.176170:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 120 off10280 00000040:00080000:1.0:1788460573.176278:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 224 off10504 00000040:00080000:1.0:1788460573.176287:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:1.0:1788460573.176392:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460573.178976:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.179031:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.179074:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615424 00000100:00100000:3.0:1788460573.179084:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615424 00000100:00100000:3.0:1788460573.179138:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788460573.179148:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460573.179621:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615424:12345-0@lo:501:mount.lustre.0 Request processed in 473us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.179630:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788460573.179931:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460573.179981:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460573.180026:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.180136:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615552 00000100:00100000:1.0:1788460573.180138:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db840 going to sleep for 11 seconds 00000100:00100000:0.0:1788460573.180141:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615552 00000100:00100000:0.0:1788460573.180193:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788460573.180201:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460573.180680:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615552:12345-0@lo:503:mount.lustre.0 Request processed in 478us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460573.180688:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788460573.180820:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788460573.181705:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460573.181932:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460573.181991:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.182032:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5036b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460573.182159:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615680 00000100:00100000:2.0:1788460573.182167:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615680 00000100:00100000:2.0:1788460573.182245:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788460573.182254:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460573.182720:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615680:12345-0@lo:502:mount.lustre.0 Request processed in 466us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460573.182729:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788460573.182856:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460573.183241:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:1.0:1788460573.183367:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 128 off8544 00000040:00080000:1.0:1788460573.183409:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 112 off8656 00000040:00080000:1.0:1788460573.183589:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8880 00000040:00080000:1.0:1788460573.183630:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9104 00000040:00080000:1.0:1788460573.183667:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 80 off9184 00000040:00080000:1.0:1788460573.183720:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9408 00000040:00080000:1.0:1788460573.183758:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9632 00000040:00080000:1.0:1788460573.183916:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 80 off9712 00000040:00080000:1.0:1788460573.183970:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off9936 00000040:00080000:1.0:1788460573.184006:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10160 00000040:00080000:1.0:1788460573.184418:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 120 off10280 00000100:00100000:1.0:1788460573.185001:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460573.185144:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.185287:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460573.188610:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615808 00000100:00100000:2.0:1788460573.188626:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615808 00000100:00100000:2.0:1788460573.188744:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788460573.188755:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460573.189027:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482615808:12345-0@lo:502:mount.lustre.0 Request processed in 273us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460573.189035:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788460573.189144:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482615808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460573.189282:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 224 off10504 00000040:00080000:1.0:1788460573.189298:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788460573.191864:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460573.191875:0:15197:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788460573.191881:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460573.191884:0:15197:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788460573.191888:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460573.191902:0:15197:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff964fc2276620) 00000020:00000080:1.0:1788460573.191922:0:15197:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788460573.191927:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788460573.191993:0:15197:0:(tgt_mount.c:167:server_get_mount()) get mount ffff964fc19a9000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788460573.192002:0:15197:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788460573.192009:0:15197:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x889bb893541b833d 00000100:00080000:0.0:1788460573.196366:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460573.196377:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460573.196379:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460573.196382:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788460573.196518:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460573.196534:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482615936:0@lo:400:kworker.0 00000100:00100000:0.0:1788460573.196608:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460573.196686:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482615936 00000100:00100000:2.0:1788460573.196695:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482615936 00000100:00100000:2.0:1788460573.196742:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460573.196751:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482615936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460573.196817:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482615936:12345-0@lo:400:kworker.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460573.196824:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788460573.196866:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650f6056d80 x1875336482615936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460573.196879:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482615936:0@lo:400:kworker.0 00010000:00010000:3.0:1788460573.200381:0:15197:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788460573.205028:0:15197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788460573.208304:0:15197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788460573.217942:0:15197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788460573.217953:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460573.217959:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460573.217962:0:15197:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788460573.217965:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788460573.217968:0:15197:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788460573.217970:0:15197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788460573.217971:0:15197:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788460573.217973:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788460573.217976:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460573.217977:0:15197:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788460573.217980:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460573.217982:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460573.217984:0:15197:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788460573.217987:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788460573.217988:0:15197:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788460573.217991:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460573.217993:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460573.217994:0:15197:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788460573.217997:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460573.218000:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460573.218001:0:15197:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788460573.218004:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788460573.218066:0:15197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460573.218069:0:15197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460573.218070:0:15197:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788460573.218074:0:15197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000020:01000000:1.0:1788460573.218580:0:15183:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788460573.218594:0:15183:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788460573.218617:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.218630:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460573.218639:0:15183:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff964fc19a9000 from 1 10000000:01000000:1.0:1788460573.218642:0:15183:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788460573.218673:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.218682:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.218692:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460573.218720:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460573.218783:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.221479:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db000 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.221644:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616064 00000100:00100000:3.0:1788460573.221653:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616064 00000100:00100000:3.0:1788460573.221704:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788460573.221714:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+15:15183:x1875336482616064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460573.221740:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460573.221758:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8344 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.221787:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8344 expref: 16 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.221798:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8344 expref: 16 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.221807:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d200, rc 0) 00000100:00100000:3.0:1788460573.221874:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+16:15183:x1875336482616064:12345-0@lo:101:mount.lustre.0 Request processed in 163us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.221881:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788460573.222005:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460573.222022:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.222031:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.223126:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616192:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788460573.223210:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.223248:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460573.226446:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616192 00000100:00100000:2.0:1788460573.226458:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616192 00000100:00100000:2.0:1788460573.226511:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788460573.226521:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+16:15183:x1875336482616192:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788460573.226545:0:14496:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788460573.226575:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788460573.226579:0:14496:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788460573.226707:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+16:15183:x1875336482616192:12345-0@lo:256:mount.lustre.0 Request processed in 186us (3494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460573.226714:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788460573.226945:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616192:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788460573.228649:0:15183:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460573.228668:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.228680:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460573.228689:0:15183:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff964fc19a9000 from 1 10000000:01000000:1.0:1788460573.228692:0:15183:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460573.228837:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.228847:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.228858:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460573.228882:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460573.228938:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460573.229099:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616320 00000100:00100000:3.0:1788460573.229107:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616320 00000100:00100000:3.0:1788460573.229158:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460573.229167:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+16:15183:x1875336482616320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460573.229197:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460573.229209:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8352 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460573.229230:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db480 going to sleep for 11 seconds 00010000:00010000:3.0:1788460573.229232:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8352 expref: 17 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.229242:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8352 expref: 17 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460573.229251:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c000, rc 0) 00000100:00100000:3.0:1788460573.229313:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616320:12345-0@lo:101:mount.lustre.0 Request processed in 147us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.229320:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788460573.229542:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460573.229611:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.229621:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460573.230106:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000040:00080000:1.0:1788460573.230664:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460573.230920:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:1.0:1788460573.230979:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:1.0:1788460573.231032:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:1.0:1788460573.231070:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:1.0:1788460573.231104:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:1.0:1788460573.231152:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:1.0:1788460573.231215:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:1.0:1788460573.231251:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:1.0:1788460573.231318:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:1.0:1788460573.231327:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 9 count 10 00000100:00100000:1.0:1788460573.231401:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460573.231798:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.231841:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.231938:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616448 00000100:00100000:3.0:1788460573.231945:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616448 00000100:00100000:3.0:1788460573.231993:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788460573.232002:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460573.232248:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616448:12345-0@lo:501:mount.lustre.0 Request processed in 246us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.232256:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460573.232337:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460573.232371:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460573.232411:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.232529:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.235370:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616576 00000100:00100000:3.0:1788460573.235385:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616576 00000100:00100000:3.0:1788460573.235588:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788460573.235600:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460573.235840:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616576:12345-0@lo:503:mount.lustre.0 Request processed in 243us (3427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460573.235848:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460573.235935:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788460573.236468:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460573.236541:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460573.237057:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.237221:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460573.237337:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616704 00000100:00100000:0.0:1788460573.237345:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616704 00000100:00100000:0.0:1788460573.237378:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788460573.237386:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460573.239505:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616704:12345-0@lo:502:mount.lustre.0 Request processed in 2112us (2441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460573.239531:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460573.239718:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460573.239985:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:1.0:1788460573.240036:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:1.0:1788460573.240080:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:1.0:1788460573.240116:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:1.0:1788460573.240147:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:1.0:1788460573.240229:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:1.0:1788460573.240263:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:1.0:1788460573.240296:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000100:00100000:1.0:1788460573.240334:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460573.240382:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.240426:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460573.240604:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616832 00000100:00100000:0.0:1788460573.240611:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616832 00000100:00100000:0.0:1788460573.240644:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788460573.240652:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460573.240819:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616832:12345-0@lo:502:mount.lustre.0 Request processed in 167us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460573.240827:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788460573.240914:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460573.240997:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:1.0:1788460573.241006:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788460573.242385:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460573.242397:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460573.242400:0:15201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788460573.242407:0:15201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff964fc19a9000 00000020:00000080:2.0:1788460573.242409:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788460573.242416:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460573.242419:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460573.242421:0:15201:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788460573.242423:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460573.242426:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460573.242427:0:15201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788460573.242542:0:15201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff964fc19a9000 00000020:00000080:2.0:1788460573.242553:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788460573.242618:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460573.242622:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460573.242624:0:15201:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788460573.242626:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460573.242629:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460573.242630:0:15201:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788460573.242634:0:15201:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff964fc19a9000 00000020:00000080:2.0:1788460573.242636:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788460573.242675:0:15201:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460573.242680:0:15201:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460573.242681:0:15201:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788460573.242684:0:15201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 10 count 10 00000020:01000000:0.0:1788460573.243845:0:15183:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788460573.243863:0:15183:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460573.243889:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.243902:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460573.243958:0:15183:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788460573.243962:0:15183:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff964fc19a9000 10000000:01000000:0.0:1788460573.243965:0:15183:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff964fc19a9000 10000000:01000000:0.0:1788460573.243969:0:15183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460573.243980:0:15183:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460573.244042:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460573.244049:0:15183:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460573.244060:0:15183:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff964fc19a9000 from 1 10000000:01000000:0.0:1788460573.244063:0:15183:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788460573.244098:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.244107:0:15183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.244127:0:15183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.244149:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460573.244232:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.244270:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482616960 00000100:00100000:0.0:1788460573.244276:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482616960 00000100:00100000:0.0:1788460573.244316:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460573.244325:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:15183:x1875336482616960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460573.244338:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460573.244351:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650fcd5bc00/0x889bb893541b8367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8360 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.244372:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650fcd5bc00/0x889bb893541b8367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8360 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.244383:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650fcd5bc00/0x889bb893541b8367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8360 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.244390:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650fcd5bc00, rc 0) 00000100:00100000:0.0:1788460573.244420:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482616960:12345-0@lo:101:mount.lustre.0 Request processed in 96us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460573.244427:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460573.246361:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460573.246394:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482616960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460573.249099:0:15183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.249127:0:15183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460573.249762:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788460573.250167:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460573.250461:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:0.0:1788460573.250510:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 120 off8536 00000040:00080000:0.0:1788460573.250545:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 168 off8704 00000040:00080000:0.0:1788460573.250613:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8928 00000040:00080000:0.0:1788460573.250655:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9152 00000040:00080000:0.0:1788460573.250723:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 120 off9272 00000040:00080000:0.0:1788460573.250759:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 168 off9440 00000040:00080000:0.0:1788460573.250794:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9664 00000040:00080000:0.0:1788460573.250843:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 224 off9888 00000040:00080000:0.0:1788460573.250877:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 120 off10008 00000040:00080000:0.0:1788460573.250911:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10232 00000040:00080000:0.0:1788460573.250959:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 224 off10456 00000040:00080000:0.0:1788460573.250995:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 88 off10544 00000040:00080000:0.0:1788460573.251032:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].14, 128 off10672 00000040:00080000:0.0:1788460573.251080:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].15, 144 off10816 00000040:00080000:0.0:1788460573.251116:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].16, 160 off10976 00000040:00080000:0.0:1788460573.251151:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].17, 224 off11200 00000040:00080000:0.0:1788460573.251225:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].18, 224 off11424 00000040:00080000:0.0:1788460573.251264:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].19, 80 off11504 00000040:00080000:0.0:1788460573.251300:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].20, 224 off11728 00000040:00080000:0.0:1788460573.251345:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].21, 224 off11952 00000040:00080000:0.0:1788460573.251400:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].22, 88 off12040 00000040:00080000:0.0:1788460573.251436:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].23, 128 off12168 00000040:00080000:0.0:1788460573.251484:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].24, 144 off12312 00000040:00080000:0.0:1788460573.251520:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].25, 128 off12440 00000040:00080000:0.0:1788460573.258627:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].26, 224 off12664 00000040:00080000:0.0:1788460573.258759:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].27, 224 off12888 00000040:00080000:0.0:1788460573.258799:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].28, 80 off12968 00000040:00080000:0.0:1788460573.258836:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].29, 224 off13192 00000040:00080000:0.0:1788460573.258888:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].30, 224 off13416 00000040:00080000:0.0:1788460573.258926:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].31, 88 off13504 00000040:00080000:0.0:1788460573.258957:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].32, 128 off13632 00000040:00080000:0.0:1788460573.258987:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].33, 144 off13776 00000040:00080000:0.0:1788460573.259034:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].34, 128 off13904 00000040:00080000:0.0:1788460573.259072:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].35, 224 off14128 00000040:00080000:0.0:1788460573.259121:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].36, 224 off14352 00000040:00080000:0.0:1788460573.259158:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].37, 80 off14432 00000040:00080000:0.0:1788460573.259238:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].38, 224 off14656 00000040:00080000:0.0:1788460573.259304:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].39, 224 off14880 00000040:00080000:0.0:1788460573.259342:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].40, 120 off15000 00000040:00080000:0.0:1788460573.259615:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].41, 224 off15224 00000040:00080000:0.0:1788460573.259625:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788460573.259720:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460573.259783:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.259827:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788460573.261733:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617088 00000100:00100000:2.0:1788460573.261745:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617088 00000100:00100000:2.0:1788460573.261799:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788460573.261810:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460573.262091:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617088:12345-0@lo:501:mount.lustre.0 Request processed in 282us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460573.262100:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788460573.263747:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460573.263802:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460573.263870:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.263901:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6c06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788460573.264268:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617216 00000100:00100000:2.0:1788460573.264275:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617216 00000100:00100000:2.0:1788460573.264317:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788460573.264325:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460573.264526:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617216:12345-0@lo:503:mount.lustre.0 Request processed in 201us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460573.264718:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788460573.264934:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788460573.265763:0:15183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460573.266018:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460573.266083:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.266136:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617344 00000100:00100000:0.0:1788460573.266142:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617344 00000100:00100000:0.0:1788460573.267696:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788460573.267712:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460573.267984:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617344:12345-0@lo:502:mount.lustre.0 Request processed in 277us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460573.267993:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788460573.271888:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c8e4dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460573.271931:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460573.272272:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1788460573.272339:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 120 off8536 00000040:00080000:1.0:1788460573.272374:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 168 off8704 00000040:00080000:1.0:1788460573.272421:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8928 00000040:00080000:1.0:1788460573.272648:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9152 00000040:00080000:1.0:1788460573.272699:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 120 off9272 00000040:00080000:1.0:1788460573.272739:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 168 off9440 00000040:00080000:1.0:1788460573.272770:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9664 00000040:00080000:1.0:1788460573.272813:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 224 off9888 00000040:00080000:1.0:1788460573.272859:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 120 off10008 00000040:00080000:1.0:1788460573.272891:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10232 00000040:00080000:1.0:1788460573.272952:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 224 off10456 00000040:00080000:1.0:1788460573.272998:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 88 off10544 00000040:00080000:1.0:1788460573.273651:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].14, 128 off10672 00000040:00080000:1.0:1788460573.273743:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].15, 144 off10816 00000040:00080000:1.0:1788460573.273783:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].16, 160 off10976 00000040:00080000:1.0:1788460573.273817:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].17, 224 off11200 00000040:00080000:1.0:1788460573.273889:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].18, 224 off11424 00000040:00080000:1.0:1788460573.273935:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].19, 80 off11504 00000040:00080000:1.0:1788460573.273979:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].20, 224 off11728 00000040:00080000:1.0:1788460573.274056:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].21, 224 off11952 00000040:00080000:1.0:1788460573.274091:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].22, 88 off12040 00000040:00080000:1.0:1788460573.274125:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].23, 128 off12168 00000040:00080000:1.0:1788460573.274171:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].24, 144 off12312 00000040:00080000:1.0:1788460573.274386:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].25, 128 off12440 00000040:00080000:1.0:1788460573.274423:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].26, 224 off12664 00000040:00080000:1.0:1788460573.274636:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].27, 224 off12888 00000040:00080000:1.0:1788460573.274675:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].28, 80 off12968 00000040:00080000:1.0:1788460573.274731:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].29, 224 off13192 00000040:00080000:1.0:1788460573.274773:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].30, 224 off13416 00000040:00080000:1.0:1788460573.274806:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].31, 88 off13504 00000040:00080000:1.0:1788460573.274840:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].32, 128 off13632 00000040:00080000:1.0:1788460573.274870:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].33, 144 off13776 00000040:00080000:1.0:1788460573.274910:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].34, 128 off13904 00000040:00080000:1.0:1788460573.274949:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].35, 224 off14128 00000040:00080000:1.0:1788460573.275012:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].36, 224 off14352 00000040:00080000:1.0:1788460573.275058:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].37, 80 off14432 00000040:00080000:1.0:1788460573.275092:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].38, 224 off14656 00000040:00080000:1.0:1788460573.275163:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].39, 224 off14880 00000040:00080000:1.0:1788460573.275270:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].40, 120 off15000 00000100:00100000:1.0:1788460573.275324:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460573.275412:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.275650:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617472 00000100:00100000:0.0:1788460573.275658:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617472 00000100:00100000:0.0:1788460573.275707:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788460573.275717:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460573.276342:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617472:12345-0@lo:502:mount.lustre.0 Request processed in 624us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460573.276351:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788460573.276685:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460573.276709:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460573.276819:0:15183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].41, 224 off15224 00000040:00080000:1.0:1788460573.276832:0:15183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788460573.279636:0:15206:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788460573.279654:0:15206:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9650f5cf3310) 00000020:00000080:0.0:1788460573.279676:0:15206:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788460573.279756:0:15206:0:(tgt_mount.c:167:server_get_mount()) get mount ffff964fc19a9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788460573.279761:0:15206:0:(tgt_mount.c:201:server_put_mount()) put mount ffff964fc19a9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788460573.279764:0:15206:0:(obd_mount.c:798:lustre_put_lsi()) put ffff964fc19a9000 3 00010000:00080000:0.0:1788460573.279898:0:15206:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964fc13c2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.132@tcp at head 00010000:00010000:0.0:1788460573.282149:0:15206:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788460573.282676:0:15206:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788460573.282711:0:15206:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788460573.282721:0:15206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x889bb893541b8375 00000100:00080000:0.0:1788460573.282730:0:15206:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788460573.282736:0:15206:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff964fc13c2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460573.282769:0:15206:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650f6054700 x1875336482617600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460573.282813:0:15206:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460573.282836:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460573.282840:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460573.282842:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460573.282845:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788460573.283102:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482617600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788460573.283174:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.283309:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617600 00000100:00100000:0.0:1788460573.283317:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617600 00000100:00100000:0.0:1788460573.283388:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460573.283395:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1875336482617600:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788460573.283417:0:14503:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1788460573.283705:0:14503:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x889bb893541b837c 00000004:00100000:0.0:1788460573.283719:0:14503:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788460573.283753:0:14503:0:(import.c:65:import_set_state_nolock()) ffff9650c3968800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460573.283813:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875336482617600:12345-0@lo:38:llog_process_th.0 Request processed in 417us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460573.283821:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788460573.285572:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650f6054700 x1875336482617600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460573.285587:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788460573.285596:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788460573.285603:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788460573.285608:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788460573.285612:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc13c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788460573.285619:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482617600:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788460573.285814:0:15206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 42 count 42 00000020:01000000:1.0:1788460573.286028:0:15183:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788460573.286042:0:15183:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788460573.286063:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.286074:0:15183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788460573.286125:0:15183:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788460573.286128:0:15183:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788460573.286130:0:15183:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460573.286131:0:15183:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460573.286132:0:15183:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460573.286134:0:15183:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460573.286135:0:15183:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460573.286137:0:15183:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460573.286139:0:15183:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788460573.286143:0:15183:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788460573.286145:0:15183:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788460573.286147:0:15183:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788460573.286148:0:15183:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460573.286149:0:15183:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460573.286150:0:15183:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460573.286151:0:15183:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460573.286152:0:15183:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460573.286154:0:15183:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460573.286160:0:15183:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788460573.286212:0:15183:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788460573.286232:0:15183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788460573.286296:0:15183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.286330:0:15183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89dbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460573.286641:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617728 00000100:00100000:0.0:1788460573.286649:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617728 00000100:00100000:0.0:1788460573.286705:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788460573.286716:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:15183:x1875336482617728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788460573.286753:0:14496:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788460573.286766:0:14496:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788460573.323252:0:14496:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788460573.323270:0:14496:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788460573.323307:0:14517:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788460573.323313:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788460573.323344:0:14517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.323364:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b82cd expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.324050:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8344 expref: 18 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.324067:0:14517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.324131:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8344 expref: 18 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.324147:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8344 expref: 18 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.324164:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482617856:0@lo:104: 00000100:00100000:0.0:1788460573.324947:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460573.325115:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b82cd expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.325126:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b82cd expref: 18 pid: 14496 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.325137:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482617984:0@lo:104: 00000100:00100000:0.0:1788460573.325159:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460573.325841:0:14517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c3c85f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460573.325933:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617856 00000100:00100000:3.0:1788460573.325942:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617856 00000100:00100000:1.0:1788460573.326390:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482617984 00000100:00100000:1.0:1788460573.326396:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482617984 00000100:00100000:1.0:1788460573.326419:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460573.326428:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2de9e0bf-5e47-4625-abae-f266e65391be+4:14517:x1875336482617856:12345-0@lo:104: 00010000:00010000:1.0:1788460573.326459:0:14486:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326526:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788460573.326549:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2de9e0bf-5e47-4625-abae-f266e65391be+4:14517:x1875336482617856:12345-0@lo:104: Request processed in 122us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460573.326566:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460573.326584:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460573.326591:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2de9e0bf-5e47-4625-abae-f266e65391be+3:14517:x1875336482617984:12345-0@lo:104: 00010000:00010000:1.0:1788460573.326599:0:14486:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326632:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788460573.326637:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2de9e0bf-5e47-4625-abae-f266e65391be+3:14517:x1875336482617984:12345-0@lo:104: Request processed in 48us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460573.326643:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788460573.326660:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460573.326666:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326689:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4a00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460573.326693:0:14491:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326702:0:14491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460573.326708:0:14491:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460573.326714:0:14491:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788460573.326744:0:14491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326751:0:14491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460573.326770:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326776:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f4a00/0x889bb893541b8344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b834b expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326788:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460573.326792:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326798:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ca00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460573.326800:0:14491:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326817:0:14491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460573.326824:0:14491:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460573.326829:0:14491:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788460573.326844:0:14491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326849:0:14491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460573.326864:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326871:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b82cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82d4 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.326884:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460573.326886:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460573.326887:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460573.326894:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460573.326906:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482618112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460573.326939:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.326970:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460573.326977:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482618240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460573.326997:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460573.327021:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482618112 00000100:00100000:1.0:1788460573.327025:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482618112 00010000:00010000:1.0:1788460573.327049:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8344 expref: 19 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460573.327071:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482618240 00000100:00100000:1.0:1788460573.327074:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482618240 00010000:00010000:1.0:1788460573.327085:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b82cd expref: 20 pid: 14496 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460573.327097:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460573.327103:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+20:3317:x1875336482618112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460573.327112:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460573.327123:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8344 expref: 20 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327133:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8344 expref: 20 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327149:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460573.327195:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+20:3317:x1875336482618112:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460573.327202:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460573.327217:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460573.327224:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+19:3319:x1875336482618240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460573.327231:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460573.327235:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b82cd expref: 19 pid: 14496 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327244:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b82cd expref: 19 pid: 14496 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327267:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327276:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788460573.327290:0:14488:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003978158s 00010000:00010000:1.0:1788460573.327294:0:14488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327300:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327307:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327313:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327318:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460573.327323:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327330:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327338:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460573.327347:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460573.327376:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+19:3319:x1875336482618240:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460573.327389:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460573.327427:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482618240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460573.327452:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482618112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460573.328385:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d200/0x889bb893541b834b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8344 expref: 18 pid: 14497 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.328401:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482617856:0@lo:104: 00010000:00010000:0.0:1788460573.328412:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650fcd5be00/0x889bb893541b82d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b82cd expref: 17 pid: 14496 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460573.328438:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482617984:0@lo:104: 00010000:00010000:0.0:1788460573.328457:0:14517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.328466:0:14517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.328472:0:14517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460573.328479:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650fcd5b200/0x889bb893541b8383 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460573.336884:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+16:15183:x1875336482617728:12345-0@lo:253:mount.lustre.0 Request processed in 50159us (50575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460573.336914:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788460573.337067:0:15183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15183:1875336482617728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788460573.337083:0:15183:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788460573.337086:0:15183:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788460573.337088:0:15183:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788460573.337089:0:15183:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460573.337090:0:15183:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460573.337091:0:15183:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460573.337093:0:15183:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460573.337094:0:15183:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460573.337096:0:15183:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460573.337098:0:15183:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788460573.337110:0:15183:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788460573.342718:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460573.342901:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788460573.343064:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460573.343292:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788460573.343658:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460573.343887:0:15183:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788460573.344924:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788460573.435027:0:15183:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788460573.435036:0:15183:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788460573.435072:0:15183:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788460573.435102:0:15183:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788460573.709375:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460574.743580:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788460575.309233:0:14499:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788460575.309241:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff964fc19a9000 from 7 10000000:01000000:1.0:1788460575.309245:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788460575.309288:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460575.309300:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460575.309310:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460575.309334:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460575.309396:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460575.309478:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d08a56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460575.309600:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482618368 00000100:00100000:3.0:1788460575.309608:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482618368 00000100:00100000:3.0:1788460575.309659:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460575.309669:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+16:14499:x1875336482618368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460575.309683:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460575.309696:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b838a expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.309717:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b838a expref: 17 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.309735:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b838a expref: 17 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.309744:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c200, rc 0) 00000100:00100000:3.0:1788460575.309788:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+17:14499:x1875336482618368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460575.309795:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460575.309840:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460575.309854:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.309862:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460575.309910:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788460575.309939:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460575.309965:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460575.309996:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482618496 00000100:00100000:3.0:1788460575.310000:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482618496 00000100:00100000:3.0:1788460575.310022:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788460575.310028:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:14499:x1875336482618496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460575.310041:0:14496:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460575.310057:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460575.310060:0:14496:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788460575.310133:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:14499:x1875336482618496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460575.310148:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788460575.310208:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788460575.310239:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460575.310246:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310254:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460575.310267:0:14499:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460575.310269:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5014000 from 7 10000000:01000000:3.0:1788460575.310271:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460575.310287:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310294:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310301:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460575.310313:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460575.310337:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460575.310351:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460575.310363:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482618624 00000100:00100000:3.0:1788460575.310366:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482618624 00000100:00100000:3.0:1788460575.310386:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460575.310392:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:14499:x1875336482618624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460575.310405:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460575.310414:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8398 expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310439:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8398 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310448:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8398 expref: 18 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310455:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029de00, rc 0) 00000100:00100000:3.0:1788460575.310483:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:14499:x1875336482618624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460575.310489:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460575.310518:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460575.310527:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310534:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460575.310582:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788460575.310610:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460575.310623:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460575.310634:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482618752 00000100:00100000:3.0:1788460575.310637:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482618752 00000100:00100000:3.0:1788460575.310656:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788460575.310662:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:14499:x1875336482618752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460575.310677:0:14496:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460575.310687:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460575.310689:0:14496:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788460575.310751:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:14499:x1875336482618752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460575.310757:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788460575.310786:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482618752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788460575.310830:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460575.310835:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460575.310843:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460575.762412:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460576.780562:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460577.804343:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788460578.316381:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460578.316388:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460578.316391:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460578.316394:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788460578.316601:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482618880:0@lo:400:kworker.0 00000100:00100000:0.0:1788460578.316677:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460578.316784:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482618880 00000100:00100000:2.0:1788460578.316792:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482618880 00000100:00100000:2.0:1788460578.316842:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460578.316852:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:3319:x1875336482618880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460578.316903:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+18:3319:x1875336482618880:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460578.316910:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788460578.317067:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482618880:0@lo:400:kworker.0 00000100:00100000:1.0:1788460578.317672:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482619008:0@lo:400:kworker.0 00000100:00100000:1.0:1788460578.317713:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460578.317748:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460578.317754:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482619136:0@lo:400:kworker.0 00000100:00100000:0.0:1788460578.317859:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619008 00000100:00100000:0.0:1788460578.317866:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619008 00000100:00100000:0.0:1788460578.317907:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460578.317915:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482619008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460578.317958:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482619008:12345-0@lo:400:kworker.0 Request processed in 44us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460578.317964:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460578.318065:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788460578.318101:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8d180 x1875336482619008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460578.318114:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482619008:0@lo:400:kworker.0 00000100:00100000:0.0:1788460578.318203:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619136 00000100:00100000:0.0:1788460578.318208:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619136 00000100:00100000:0.0:1788460578.318241:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460578.318248:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482619136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460578.318297:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482619136:12345-0@lo:400:kworker.0 Request processed in 50us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460578.318304:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788460578.318331:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8c700 x1875336482619136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460578.318340:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482619136:0@lo:400:kworker.0 00000100:00080000:2.0:1788460578.318411:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460578.831438:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460579.864262:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788460580.106421:0:15548:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788460580.301967:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788460580.877325:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460581.900492:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460582.924578:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460583.438927:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788460583.438950:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460583.438955:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788460583.438957:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460583.438960:0:38:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788460583.439029:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460583.439052:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482619392:0@lo:400:kworker.0 00000100:00100000:0.0:1788460583.439121:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460583.439239:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482619264:0@lo:400:kworker.0 00000100:00100000:1.0:1788460583.439303:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460583.439304:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619392 00000100:00100000:2.0:1788460583.439313:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619392 00000100:00100000:2.0:1788460583.439374:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460583.439385:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482619392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460583.439467:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482619392:12345-0@lo:400:kworker.0 Request processed in 85us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460583.439475:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788460583.439551:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650efdd1c00 x1875336482619392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460583.439565:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482619392:0@lo:400:kworker.0 00000100:00100000:3.0:1788460583.439814:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482619520:0@lo:400:kworker.0 00000100:00100000:3.0:1788460583.439849:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460583.440061:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619520 00000100:00100000:3.0:1788460583.440067:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619520 00000100:00100000:3.0:1788460583.440103:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460583.440110:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482619520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460583.440165:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482619520:12345-0@lo:400:kworker.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460583.440172:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788460583.440208:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788460583.440228:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650efdd1880 x1875336482619520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460583.440239:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482619520:0@lo:400:kworker.0 00000100:00100000:0.0:1788460583.441125:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619264 00000100:00100000:0.0:1788460583.441134:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619264 00000100:00100000:0.0:1788460583.441237:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788460583.441246:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+18:3319:x1875336482619264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460583.441325:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+18:3319:x1875336482619264:12345-0@lo:400:kworker.0 Request processed in 80us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460583.441332:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788460583.441413:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482619264:0@lo:400:kworker.0 00000100:00100000:0.0:1788460583.500313:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460568/real 1788460568] req@ffff9650ec01ed80 x1875336482613888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460583.500345:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650ec01ed80 x1875336482613888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460583.500379:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460568/real 1788460568] req@ffff9650ec01df80 x1875336482614016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460583 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460583.500394:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650ec01df80 x1875336482614016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460583 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788460583.500413:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460583.500506:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460583.500511:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482613888:0@lo:8:kworker.0 00000100:00080000:0.0:1788460583.500517:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460583.501874:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460583.501881:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788460583.501886:0:38:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460583.501893:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:3.0:1788460583.501898:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460583.501905:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9650f5cff800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1788460583.501943:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efdd1880 x1875336482619648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460583.501958:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460583.501961:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788460583.501963:0:38:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460583.501966:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:3.0:1788460583.501969:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460583.501973:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650f5cfa800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1788460583.501984:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efdd1f80 x1875336482619776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460583.509536:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460583.509549:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482614016:0@lo:8:kworker.0 00000100:00100000:0.0:1788460583.509592:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482619648:0@lo:8:kworker.0 00000100:00100000:0.0:1788460583.509663:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460583.509781:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619648 00000100:00100000:1.0:1788460583.509789:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619648 00000100:00100000:1.0:1788460583.509832:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460583.509840:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1875336482619648:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788460583.509868:0:15184:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:1.0:1788460583.509894:0:15184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b83a6 00000100:00100000:0.0:1788460583.509897:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482619776:0@lo:8:kworker.0 00002000:00100000:1.0:1788460583.509909:0:15184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9650f5c60800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788460583.509914:0:15184:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788460583.509930:0:15184:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788460583.509933:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788460583.510288:0:15184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788460583.510312:0:15184:0:(import.c:65:import_set_state_nolock()) ffff9650f5c63800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460583.510375:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875336482619648:12345-0@lo:8:kworker.0 Request processed in 533us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460583.510383:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460583.510398:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619776 00000100:00100000:1.0:1788460583.510402:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619776 00000100:00100000:1.0:1788460583.510415:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460583.510419:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1875336482619776:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788460583.510430:0:15184:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788460583.510458:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1875336482619776:12345-0@lo:8:kworker.0 Request processed in 37us (526us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788460583.510464:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788460583.511329:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650efdd1880 x1875336482619648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460583.511340:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788460583.511349:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788460583.511357:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788460583.511372:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788460583.511375:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788460583.511450:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788460583.511457:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482619648:0@lo:8:kworker.0 00000100:00080000:0.0:1788460583.511484:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460583.511498:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788460583.511501:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482619776:0@lo:8:kworker.0 00000004:00080000:1.0:1788460583.511776:0:14523:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788460583.512131:0:14523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 456747951287ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788460583.525011:0:14524:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788460583.525050:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460583.525072:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482619904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460583.525142:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460583.525302:0:14524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875336482620032:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788460583.525334:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482619904 00000100:00100000:1.0:1788460583.525342:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482619904 00000100:00100000:1.0:1788460583.525389:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460583.525398:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482619904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460583.525429:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460583.525477:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482619904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460583.525484:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788460583.525522:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460583.525560:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff965101d8d880 x1875336482619904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460583.525581:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482619904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460583.526544:0:14524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460583.526625:0:14524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d105da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460583.538630:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620032 00000100:00100000:1.0:1788460583.538645:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620032 00000100:00100000:1.0:1788460583.538722:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460583.538733:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14524:x1875336482620032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788460583.541255:0:15184:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788460583.541265:0:15184:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788460583.541270:0:15184:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788460583.571568:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.571582:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571599:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.571603:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.571609:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571627:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571638:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571646:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571667:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460583.571681:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460583.571695:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571703:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460583.571708:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571716:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571733:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571740:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a95aa1/0x889bb893541b83ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.571762:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.571765:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.571768:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.572384:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.572391:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572400:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.572404:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.572408:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572429:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572439:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572446:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572464:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460583.572474:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460583.572479:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572497:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460583.572501:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572509:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572521:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572529:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d98dcb9/0x889bb893541b83b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.572556:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.572558:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.572560:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.573008:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.573014:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573022:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.573026:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.573030:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573039:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573046:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573053:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573072:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460583.573232:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.573247:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.573257:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.573261:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.573272:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.573288:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.573297:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099ae4456/0x889bb893541b83bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460583.573470:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.573476:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573505:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.573507:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.573511:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573520:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573527:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573533:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573547:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460583.573554:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460583.573558:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573564:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460583.573567:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573580:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573601:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573607:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea206f23/0x889bb893541b83c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.573619:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.573621:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.573622:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.573994:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.574001:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574010:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.574013:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.574018:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574026:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574034:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574040:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574064:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460583.574072:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460583.574076:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574082:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460583.574085:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574093:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574104:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574110:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a932fca5/0x889bb893541b83c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.574124:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.574125:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.574127:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.581231:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.581246:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.581514:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.581525:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.581532:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.581547:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.581557:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.581565:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.581589:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460583.581861:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.581875:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.581886:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.581890:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.581900:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.581929:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.581937:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b86439/0x889bb893541b83d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.581964:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.581967:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.581969:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460583.582548:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460583.582552:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460583.582554:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.582694:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.582702:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.582713:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.582717:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.582722:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.582733:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.582743:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.582756:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.582777:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460583.583047:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.583053:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.583060:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.583064:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.583072:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.583085:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.583092:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000745dbad9/0x889bb893541b83d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.583121:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.583123:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.583125:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.586581:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.586596:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586615:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.586620:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.586626:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586641:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586651:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586659:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586679:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460583.586692:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460583.586697:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586713:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460583.586718:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586727:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586743:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586751:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a14287f/0x889bb893541b83de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.586771:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.586773:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.586775:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.588292:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.588302:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588318:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.588322:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.588327:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588349:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588785:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588794:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588813:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460583.588824:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460583.588828:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588836:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460583.588840:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588849:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588906:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588915:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009769a8bf/0x889bb893541b83e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.588935:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.588943:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460583.588944:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.594299:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.594315:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.594333:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.594337:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.594343:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.594357:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.594381:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.594397:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.594422:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788460583.595031:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460583.595032:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460583.595040:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595043:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595057:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1788460583.595060:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460583.595063:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460583.595066:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595070:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595078:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595094:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595104:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595107:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595114:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595120:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d490dc6e/0x889bb893541b83ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595141:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460583.595149:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.595153:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595159:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.595162:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595164:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.595202:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595214:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595223:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea4e5bfe/0x889bb893541b83f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595239:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.595242:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.595244:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.595584:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.595590:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595599:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.595602:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.595606:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595614:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595622:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595639:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.595660:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460583.595891:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.595898:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595906:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.595910:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595919:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595931:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595950:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005682bd4d/0x889bb893541b83fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.595971:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.595974:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.595977:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.596000:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.596006:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596014:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.596016:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.596020:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596028:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596035:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596042:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596061:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788460583.596521:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.596527:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596540:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.596542:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.596546:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596555:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596563:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596570:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.596581:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788460583.597042:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.597047:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.597055:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.597058:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.597061:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.597070:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.597088:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.597095:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.597102:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788460583.597405:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460583.597412:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597422:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.597427:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597445:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597462:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597470:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f18ad3b/0x889bb893541b8401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597500:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460583.597503:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597516:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.597519:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597527:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597538:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597545:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597557:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.597560:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597566:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.597569:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597576:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597586:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597599:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7291e88/0x889bb893541b840f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.597612:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.597614:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.597615:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.597623:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460583.606841:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460583.606855:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.606885:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=456s v=(0 0) 00010000:00010000:1.0:1788460583.606889:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460583.606895:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.606910:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.606920:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.606927:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460583.606966:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460583.606989:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.606998:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.607008:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.607013:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.607024:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.607042:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.607050:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.607069:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.607072:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.607080:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460583.607986:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.607995:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.608007:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.608010:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.608015:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.608027:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.608036:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.608043:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.608078:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460583.608284:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.608290:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.608298:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.608302:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.608310:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.608325:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.608333:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8b0585e/0x889bb893541b841d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.608349:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.608350:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.608352:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460583.608844:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.608850:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.609068:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.609074:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.609088:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.609099:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.609109:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.609116:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.609133:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460583.611006:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.611017:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.611029:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ae00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.611033:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.611056:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.611076:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.611083:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf21d7b8/0x889bb893541b8424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.611104:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.611105:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.611107:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460583.611825:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.611833:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.611845:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.611856:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.612018:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.612033:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.612044:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.612053:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.612070:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460583.612536:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.612543:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.612552:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.612556:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.612566:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.612580:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.612599:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cece49ca/0x889bb893541b842b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.612616:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.612618:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.612620:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788460583.612955:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788460583.613643:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.613652:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.613665:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.613668:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.613673:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.613684:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.613692:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.613706:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.613731:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460583.622793:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460583.622806:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.622820:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.622826:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.622836:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.622858:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.622874:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9b2d9dc/0x889bb893541b8432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.622904:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.622906:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460583.622921:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460583.623787:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.623797:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.623811:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.623816:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.623822:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.623835:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.623845:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.623854:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.623889:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460583.624068:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.624076:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.624085:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.624090:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.624100:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.624117:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.624126:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092cdf38b/0x889bb893541b8439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.624150:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.624152:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.624154:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460583.625041:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.625050:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625069:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.625074:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.625079:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625092:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625103:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625111:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625257:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460583.625674:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.625679:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625688:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.625691:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.625695:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625703:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625722:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.625729:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.632701:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460583.632718:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.632738:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460583.632744:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.632756:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.632778:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.632786:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf139db/0x889bb893541b8440 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.633215:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.633222:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.633242:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.633245:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.633253:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.633266:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.633276:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.633279:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.633282:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460583.633992:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460583.634002:0:15184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b47e414d/0x889bb893541b8447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460583.634674:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.634683:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.634696:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.634701:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.634707:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.634720:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.634730:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.634750:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.636343:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.636356:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.636369:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5be00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.636373:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.636383:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.636403:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.636419:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.636421:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.636423:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460583.637670:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460583.637684:0:15184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf8da976/0x889bb893541b844e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.637939:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460583.638547:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.638555:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.638649:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.638654:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.638659:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.638674:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.638684:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.638692:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.638729:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460583.638764:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.638771:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.638779:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.638783:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.638793:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.638808:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.638816:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3382621/0x889bb893541b8455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.638834:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.638836:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.638838:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460583.639738:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.639747:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.639760:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.639764:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.639769:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.639781:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.639789:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.639797:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.640016:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460583.640437:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460583.640444:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.640454:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788460583.640463:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460583.640468:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.640478:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.642279:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.642302:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.642705:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788460583.646772:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460583.646787:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.646819:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.646824:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.646836:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.646858:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.646932:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c71813ee/0x889bb893541b845c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.646968:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460583.646973:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.646979:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460583.646982:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.646990:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.647001:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.647016:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b749b30/0x889bb893541b8463 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460583.647030:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.647032:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.647034:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.647046:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.647048:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460583.647049:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460583.648428:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460583.648438:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.648453:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1788460583.648457:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460583.648463:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.648476:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.648503:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.648512:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460583.648534:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788460583.648716:0:15184:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788460583.648819:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14524:x1875336482620032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 110084us (122273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460583.648832:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788460583.650641:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460583.650654:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.650668:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460583.650673:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.650684:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.650705:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.650734:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d77a134d/0x889bb893541b846a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460583.650760:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460583.650763:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460583.650764:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460583.654037:0:14524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875336482620032:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788460583.654059:0:14524:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788460583.654112:0:14524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875336482620160:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788460583.654300:0:14524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460583.654353:0:14524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460583.654409:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620160 00000100:00100000:2.0:1788460583.654416:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620160 00000100:00100000:2.0:1788460583.654469:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460583.654478:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14524:x1875336482620160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788460583.654531:0:15187:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788460583.665297:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14524:x1875336482620160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10810us (10988us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788460583.665309:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460583.665473:0:14524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14524:1875336482620160:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788460583.665497:0:14524:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788460583.948370:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788460584.067851:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788460584.067867:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1788460584.976245:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460585.997335:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460587.022650:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788460587.177268:0:15899:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:0.0:1788460587.177272:0:15899:0:(obd_mount.c:1014:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788460587.178081:0:15899:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9650c4ec5800 00000020:01000004:0.0:1788460587.178098:0:15899:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788460587.178112:0:15899:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788460587.178126:0:15899:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9650f5cf4c98) 00000020:00000080:0.0:1788460587.178143:0:15899:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788460587.204212:0:15899:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788460587.204634:0:15899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788460587.206026:0:15899:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788460587.206283:0:15899:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788460587.206622:0:15899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788460587.207107:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 527: rc = 0 00100000:10000000:1.0:1788460587.207416:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 527: rc = 0 00100000:10000000:1.0:1788460587.207529:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 527: rc = 0 00100000:10000000:1.0:1788460587.208318:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 582: rc = 0 00100000:10000000:1.0:1788460587.208725:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 582: rc = 0 00100000:10000000:1.0:1788460587.209104:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 582: rc = 0 00100000:10000000:1.0:1788460587.209541:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 582: rc = 0 00100000:10000000:1.0:1788460587.210047:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 582: rc = 0 00100000:10000000:1.0:1788460587.210410:0:15899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 582: rc = 0 00000020:00000080:1.0:1788460587.211311:0:15899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788460587.211324:0:15899:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788460587.211403:0:15899:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x889bb893541b8478 00000020:01000004:1.0:1788460587.211412:0:15899:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788460587.211437:0:15899:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788460587.211440:0:15899:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788460587.211445:0:15899:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788460587.211488:0:15899:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.132@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788460587.211492:0:15899:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788460587.211493:0:15899:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788460587.211495:0:15899:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460587.211496:0:15899:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460587.211498:0:15899:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460587.211499:0:15899:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460587.211501:0:15899:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460587.211503:0:15899:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460587.211504:0:15899:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788460587.211507:0:15899:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788460587.211510:0:15899:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788460587.211511:0:15899:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788460587.211512:0:15899:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460587.211513:0:15899:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460587.211515:0:15899:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460587.211516:0:15899:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460587.211516:0:15899:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460587.211518:0:15899:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460587.211519:0:15899:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788460587.211553:0:15899:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788460587.211572:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620288:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788460587.211637:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.211751:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f59066c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460587.211841:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620288 00000100:00100000:0.0:1788460587.211849:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620288 00000100:00100000:0.0:1788460587.211898:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788460587.211909:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c533b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+18:15899:x1875336482620288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788460587.211938:0:14497:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788460587.211941:0:14497:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788460587.211944:0:14497:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788460587.219880:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c533b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+18:15899:x1875336482620288:12345-0@lo:253:mount.lustre.0 Request processed in 7964us (8234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460587.219905:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788460587.220164:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788460587.220203:0:15899:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788460587.220207:0:15899:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788460587.220209:0:15899:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788460587.220210:0:15899:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460587.220212:0:15899:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460587.220221:0:15899:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460587.220223:0:15899:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460587.220224:0:15899:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460587.220226:0:15899:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460587.220228:0:15899:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788460587.220246:0:15899:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9650c4ec5800 from lustre-OST0001 10000000:01000000:1.0:1788460587.220275:0:15899:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788460587.220277:0:15899:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788460587.220285:0:15899:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9650c4ec5800 10000000:01000000:1.0:1788460587.220291:0:15899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788460587.220305:0:15899:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788460587.224026:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460587.229995:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460587.230015:0:15899:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650c4ec5800 from 1 10000000:01000000:1.0:1788460587.230020:0:15899:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788460587.230060:0:15899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.230072:0:15899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.230083:0:15899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.230105:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460587.230162:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.230299:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460587.230440:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620416 00000100:00100000:0.0:1788460587.230447:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620416 00000100:00100000:0.0:1788460587.230531:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788460587.230539:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c533a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+18:15899:x1875336482620416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460587.230558:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460587.230570:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167800/0x889bb893541b8486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b847f expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.230593:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167800/0x889bb893541b8486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b847f expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.230603:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167800/0x889bb893541b8486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b847f expref: 19 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.230613:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167800, rc 0) 00000100:00100000:0.0:1788460587.230653:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c533a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+19:15899:x1875336482620416:12345-0@lo:101:mount.lustre.0 Request processed in 114us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460587.230660:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788460587.230720:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460587.230735:0:15899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.230744:0:15899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.230924:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460587.230951:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.231165:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460587.231439:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620544 00000100:00100000:2.0:1788460587.231445:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620544 00000100:00100000:2.0:1788460587.231486:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788460587.231494:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c533a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+19:15899:x1875336482620544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460587.231861:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c533a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+19:15899:x1875336482620544:12345-0@lo:501:mount.lustre.0 Request processed in 366us (907us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460587.231869:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788460587.232060:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620544:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788460587.232079:0:15899:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788460587.232324:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460587.232418:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.232489:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460587.232519:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620672 00000100:00100000:2.0:1788460587.232523:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620672 00000100:00100000:2.0:1788460587.232635:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788460587.232643:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+19:15899:x1875336482620672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460587.232788:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+19:15899:x1875336482620672:12345-0@lo:501:mount.lustre.0 Request processed in 145us (370us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460587.232796:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788460587.232862:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620672:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788460587.233014:0:15899:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788460587.233034:0:15899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.233045:0:15899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460587.233056:0:15899:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9650c4ec5800 10000000:01000000:1.0:1788460587.233061:0:15899:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788460587.233078:0:15899:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788460587.233164:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460587.233170:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460587.233281:0:15899:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788460587.233287:0:15899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788460587.233313:0:15899:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:1.0:1788460587.233425:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460587.233435:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460587.233440:0:15899:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9650c4ec5800 10000000:01000000:1.0:1788460587.233443:0:15899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788460587.233459:0:15899:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788460587.233805:0:15899:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788460587.233838:0:15899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.233847:0:15899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.233856:0:15899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.233874:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460587.233979:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.234022:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906000 going to sleep for 11 seconds 00000100:00100000:3.0:1788460587.234087:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620800 00000100:00100000:3.0:1788460587.234094:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620800 00000100:00100000:3.0:1788460587.234138:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788460587.234146:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+19:15899:x1875336482620800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460587.234157:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460587.234168:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029c600/0x889bb893541b8494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b848d expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460587.234217:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029c600/0x889bb893541b8494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b848d expref: 20 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460587.234228:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029c600/0x889bb893541b8494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b848d expref: 20 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460587.234235:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c600, rc 0) 00000100:00100000:3.0:1788460587.234271:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482620800:12345-0@lo:101:mount.lustre.0 Request processed in 127us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460587.234288:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788460587.234501:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460587.234516:0:15899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.234524:0:15899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460587.237335:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788460587.238823:0:15899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460587.239128:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788460587.239169:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 128 off8544 00000040:00080000:1.0:1788460587.239236:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 112 off8656 00000040:00080000:1.0:1788460587.239285:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8880 00000040:00080000:1.0:1788460587.239344:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9104 00000040:00080000:1.0:1788460587.239383:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 80 off9184 00000040:00080000:1.0:1788460587.239432:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9408 00000040:00080000:1.0:1788460587.239483:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9632 00000040:00080000:1.0:1788460587.239532:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 120 off9752 00000040:00080000:1.0:1788460587.239982:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off9976 00000040:00080000:1.0:1788460587.239993:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:1.0:1788460587.240084:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460587.240149:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.240328:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460587.240500:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482620928 00000100:00100000:3.0:1788460587.240507:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482620928 00000100:00100000:3.0:1788460587.240659:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788460587.240717:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482620928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460587.241444:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482620928:12345-0@lo:501:mount.lustre.0 Request processed in 774us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460587.241453:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788460587.241739:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482620928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460587.241782:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460587.241832:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.241999:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460587.242037:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621056 00000100:00100000:3.0:1788460587.242042:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621056 00000100:00100000:3.0:1788460587.242079:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788460587.242088:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482621056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460587.242563:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482621056:12345-0@lo:503:mount.lustre.0 Request processed in 475us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460587.242570:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788460587.242877:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788460587.243666:0:15899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460587.243815:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460587.243875:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.244061:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460587.244098:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621184 00000100:00100000:3.0:1788460587.244105:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621184 00000100:00100000:3.0:1788460587.244213:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788460587.244225:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482621184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460587.244447:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482621184:12345-0@lo:502:mount.lustre.0 Request processed in 225us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460587.244454:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788460587.246287:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460587.247058:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788460587.247122:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 128 off8544 00000040:00080000:1.0:1788460587.247161:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 112 off8656 00000040:00080000:1.0:1788460587.247257:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8880 00000040:00080000:1.0:1788460587.247296:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9104 00000040:00080000:1.0:1788460587.247329:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 80 off9184 00000040:00080000:1.0:1788460587.247390:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9408 00000040:00080000:1.0:1788460587.247446:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9632 00000040:00080000:1.0:1788460587.247508:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 120 off9752 00000100:00100000:1.0:1788460587.247556:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460587.247629:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.248828:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906840 going to sleep for 11 seconds 00000100:00100000:0.0:1788460587.249098:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621312 00000100:00100000:0.0:1788460587.249106:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621312 00000100:00100000:0.0:1788460587.249151:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460587.249160:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482621312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460587.249619:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482621312:12345-0@lo:502:mount.lustre.0 Request processed in 458us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460587.249628:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788460587.249804:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460587.250119:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off9976 00000040:00080000:1.0:1788460587.250133:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788460587.252241:0:15900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460587.252251:0:15900:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788460587.252257:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460587.252259:0:15900:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788460587.252264:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460587.252279:0:15900:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff964fc2270000) 00000020:00000080:1.0:1788460587.252303:0:15900:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788460587.252310:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788460587.252526:0:15900:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650c4ec5800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788460587.252535:0:15900:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788460587.252542:0:15900:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x889bb893541b84a2 00010000:00010000:1.0:1788460587.259321:0:15900:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788460587.261154:0:15900:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788460587.264638:0:15900:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788460587.266811:0:15900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788460587.266822:0:15900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460587.266829:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460587.266831:0:15900:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788460587.266834:0:15900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460587.266954:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460587.266956:0:15900:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788460587.266961:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788460587.266963:0:15900:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788460587.266974:0:15900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460587.266976:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460587.266978:0:15900:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788460587.266980:0:15900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460587.266982:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460587.266983:0:15900:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788460587.266986:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788460587.267042:0:15900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460587.267045:0:15900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460587.267046:0:15900:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788460587.267048:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000020:01000000:0.0:1788460587.270586:0:15899:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788460587.270605:0:15899:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788460587.270628:0:15899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.270648:0:15899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460587.270655:0:15899:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c4ec5800 from 1 10000000:01000000:0.0:1788460587.270658:0:15899:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788460587.270695:0:15899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.270704:0:15899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.270714:0:15899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460587.270738:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460587.270802:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.270857:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460587.271062:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621440 00000100:00100000:1.0:1788460587.271070:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621440 00000100:00100000:1.0:1788460587.271113:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788460587.271123:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482621440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460587.271136:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460587.271148:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b84a9 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.271170:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b84a9 expref: 21 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.271200:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b84a9 expref: 21 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.271209:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4a00, rc 0) 00000100:00100000:1.0:1788460587.271249:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+21:15899:x1875336482621440:12345-0@lo:101:mount.lustre.0 Request processed in 127us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.271255:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788460587.271354:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460587.271368:0:15899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.271377:0:15899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460587.273068:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621568:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788460587.273136:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.273207:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460587.273357:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621568 00000100:00100000:3.0:1788460587.273366:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621568 00000100:00100000:3.0:1788460587.273418:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788460587.273427:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+21:15899:x1875336482621568:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788460587.273455:0:14496:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788460587.273485:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460587.273490:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788460587.273493:0:14496:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 7 00000100:00100000:3.0:1788460587.273579:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+21:15899:x1875336482621568:12345-0@lo:256:mount.lustre.0 Request processed in 153us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460587.273588:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788460587.273991:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621568:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788460587.276317:0:15899:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460587.276345:0:15899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.276359:0:15899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460587.276368:0:15899:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c4ec5800 from 1 10000000:01000000:0.0:1788460587.276371:0:15899:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788460587.276410:0:15899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.276418:0:15899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.276429:0:15899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460587.276456:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460587.276538:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.276586:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460587.276819:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621696 00000100:00100000:1.0:1788460587.276827:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621696 00000100:00100000:1.0:1788460587.276906:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788460587.276923:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+21:15899:x1875336482621696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460587.276936:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460587.276948:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b84b7 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.276971:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b84b7 expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.276981:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b84b7 expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.276989:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5a00, rc 0) 00000100:00100000:1.0:1788460587.277035:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482621696:12345-0@lo:101:mount.lustre.0 Request processed in 114us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.277043:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788460587.277497:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460587.277512:0:15899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.277521:0:15899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460587.281439:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:0.0:1788460587.285410:0:15899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460587.285680:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788460587.285725:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:0.0:1788460587.285772:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:0.0:1788460587.285806:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:0.0:1788460587.286489:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:0.0:1788460587.286579:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:0.0:1788460587.286615:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9536 00000040:00080000:0.0:1788460587.286649:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 128 off9664 00000040:00080000:0.0:1788460587.286725:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788460587.286732:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:0.0:1788460587.286823:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460587.287128:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.287236:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460587.294580:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621824 00000100:00100000:1.0:1788460587.294595:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621824 00000100:00100000:1.0:1788460587.294653:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788460587.294664:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482621824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460587.295794:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482621824:12345-0@lo:501:mount.lustre.0 Request processed in 1128us (8661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.295805:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788460587.296225:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460587.296279:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460587.296330:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460587.297971:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c7f29600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460587.299068:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482621952 00000100:00100000:3.0:1788460587.299079:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482621952 00000100:00100000:3.0:1788460587.299202:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788460587.299214:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482621952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460587.299606:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482621952:12345-0@lo:503:mount.lustre.0 Request processed in 393us (3274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460587.299615:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460587.300494:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482621952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788460587.301904:0:15899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460587.302102:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460587.302173:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.302235:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460587.302310:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622080 00000100:00100000:1.0:1788460587.302317:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622080 00000100:00100000:1.0:1788460587.302364:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788460587.302373:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482622080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460587.302609:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482622080:12345-0@lo:502:mount.lustre.0 Request processed in 236us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.302625:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460587.302759:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460587.303254:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788460587.303308:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:0.0:1788460587.304104:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:0.0:1788460587.304158:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:0.0:1788460587.304212:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:0.0:1788460587.304259:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:0.0:1788460587.304311:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:0.0:1788460587.304423:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000100:00100000:0.0:1788460587.304478:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460587.304678:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.304723:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30536c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460587.305066:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622208 00000100:00100000:2.0:1788460587.305073:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622208 00000100:00100000:2.0:1788460587.305122:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788460587.305131:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482622208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460587.306275:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482622208:12345-0@lo:502:mount.lustre.0 Request processed in 1140us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.306286:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788460587.306446:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460587.306769:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788460587.306783:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788460587.308437:0:15904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460587.308451:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460587.308454:0:15904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788460587.308475:0:15904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650c4ec5800 00000020:00000080:3.0:1788460587.308479:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460587.308486:0:15904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460587.308489:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460587.308490:0:15904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788460587.308493:0:15904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460587.308495:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460587.308497:0:15904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788460587.308500:0:15904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650c4ec5800 00000020:00000080:3.0:1788460587.308501:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460587.308660:0:15904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460587.308664:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460587.308665:0:15904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788460587.308678:0:15904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460587.308682:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460587.308683:0:15904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788460587.308686:0:15904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9650c4ec5800 00000020:00000080:3.0:1788460587.308688:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460587.310041:0:15904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460587.310050:0:15904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460587.310052:0:15904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788460587.310057:0:15904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000020:01000000:0.0:1788460587.322809:0:15899:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788460587.322831:0:15899:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460587.322856:0:15899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.322870:0:15899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460587.323054:0:15899:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788460587.323057:0:15899:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9650c4ec5800 10000000:01000000:0.0:1788460587.323060:0:15899:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9650c4ec5800 10000000:01000000:0.0:1788460587.323065:0:15899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460587.323079:0:15899:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788460587.323149:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460587.323157:0:15899:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460587.323169:0:15899:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650c4ec5800 from 1 10000000:01000000:0.0:1788460587.323172:0:15899:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788460587.323224:0:15899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.323232:0:15899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.323256:0:15899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460587.323279:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460587.324744:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.324807:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460587.324979:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622336 00000100:00100000:1.0:1788460587.324988:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622336 00000100:00100000:1.0:1788460587.325038:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460587.325047:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+22:15899:x1875336482622336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460587.325064:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460587.325080:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb4600/0x889bb893541b84cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b84c5 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.325106:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb4600/0x889bb893541b84cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b84c5 expref: 23 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.325116:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb4600/0x889bb893541b84cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b84c5 expref: 23 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.325125:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4600, rc 0) 00000100:00100000:1.0:1788460587.325201:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622336:12345-0@lo:101:mount.lustre.0 Request processed in 155us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.325207:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788460587.325446:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460587.325476:0:15899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460587.325486:0:15899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460587.331460:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 42 count 42 00000040:00080000:0.0:1788460587.336952:0:15899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460587.337279:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:0.0:1788460587.337324:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 120 off8536 00000040:00080000:0.0:1788460587.337381:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 168 off8704 00000040:00080000:0.0:1788460587.337428:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8928 00000040:00080000:0.0:1788460587.339674:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9152 00000040:00080000:0.0:1788460587.339820:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9272 00000040:00080000:0.0:1788460587.339878:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 168 off9440 00000040:00080000:0.0:1788460587.340027:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9664 00000040:00080000:0.0:1788460587.340085:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:0.0:1788460587.340124:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 120 off10008 00000040:00080000:0.0:1788460587.340155:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10232 00000040:00080000:0.0:1788460587.340293:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 224 off10456 00000040:00080000:0.0:1788460587.340329:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 88 off10544 00000040:00080000:0.0:1788460587.340478:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 128 off10672 00000040:00080000:0.0:1788460587.340534:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 144 off10816 00000040:00080000:0.0:1788460587.341970:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 160 off10976 00000040:00080000:0.0:1788460587.342013:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 224 off11200 00000040:00080000:0.0:1788460587.342084:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11424 00000040:00080000:0.0:1788460587.342145:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 80 off11504 00000040:00080000:0.0:1788460587.342422:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 224 off11728 00000040:00080000:0.0:1788460587.342494:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11952 00000040:00080000:0.0:1788460587.342530:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 88 off12040 00000040:00080000:0.0:1788460587.344199:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 128 off12168 00000040:00080000:0.0:1788460587.344290:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 144 off12312 00000040:00080000:0.0:1788460587.344329:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 128 off12440 00000040:00080000:0.0:1788460587.344628:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 224 off12664 00000040:00080000:0.0:1788460587.344681:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 224 off12888 00000040:00080000:0.0:1788460587.344717:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 80 off12968 00000040:00080000:0.0:1788460587.344748:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 224 off13192 00000040:00080000:0.0:1788460587.344793:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13416 00000040:00080000:0.0:1788460587.344826:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 88 off13504 00000040:00080000:0.0:1788460587.345038:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 128 off13632 00000040:00080000:0.0:1788460587.345074:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 144 off13776 00000040:00080000:0.0:1788460587.345126:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 128 off13904 00000040:00080000:0.0:1788460587.345247:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 224 off14128 00000040:00080000:0.0:1788460587.345299:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 224 off14352 00000040:00080000:0.0:1788460587.345695:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 80 off14432 00000040:00080000:0.0:1788460587.345741:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 224 off14656 00000040:00080000:0.0:1788460587.345792:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14880 00000040:00080000:0.0:1788460587.345830:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 120 off15000 00000040:00080000:0.0:1788460587.346007:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 224 off15224 00000040:00080000:0.0:1788460587.346016:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 41 count 42 00000100:00100000:0.0:1788460587.346117:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460587.348930:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.352593:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460587.353770:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622464 00000100:00100000:2.0:1788460587.353783:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622464 00000100:00100000:0.0:1788460587.353993:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788460587.354008:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460587.354449:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622464:12345-0@lo:501:mount.lustre.0 Request processed in 444us (5524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460587.354457:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788460587.354988:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460587.355040:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460587.355094:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460587.355235:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d30530c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460587.359115:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622592 00000100:00100000:2.0:1788460587.359128:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622592 00000100:00100000:2.0:1788460587.360802:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788460587.360823:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460587.361804:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622592:12345-0@lo:503:mount.lustre.0 Request processed in 982us (6707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.361815:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788460587.364423:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622592:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788460587.367695:0:15899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460587.367797:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460587.368034:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.368134:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460587.369592:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622720 00000100:00100000:0.0:1788460587.369603:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622720 00000100:00100000:0.0:1788460587.369661:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788460587.369671:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460587.370849:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622720:12345-0@lo:502:mount.lustre.0 Request processed in 1165us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460587.370859:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788460587.371007:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460587.371306:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:2.0:1788460587.371373:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 120 off8536 00000040:00080000:2.0:1788460587.371407:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 168 off8704 00000040:00080000:2.0:1788460587.371451:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8928 00000040:00080000:2.0:1788460587.371499:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9152 00000040:00080000:2.0:1788460587.371544:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9272 00000040:00080000:2.0:1788460587.371581:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 168 off9440 00000040:00080000:2.0:1788460587.371615:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9664 00000040:00080000:2.0:1788460587.371664:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:2.0:1788460587.371701:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 120 off10008 00000040:00080000:2.0:1788460587.371736:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10232 00000040:00080000:2.0:1788460587.371783:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 224 off10456 00000040:00080000:2.0:1788460587.371826:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 88 off10544 00000040:00080000:2.0:1788460587.371863:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 128 off10672 00000040:00080000:2.0:1788460587.371922:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 144 off10816 00000040:00080000:2.0:1788460587.371964:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 160 off10976 00000040:00080000:2.0:1788460587.372007:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 224 off11200 00000040:00080000:2.0:1788460587.372056:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11424 00000040:00080000:2.0:1788460587.372089:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 80 off11504 00000040:00080000:2.0:1788460587.372119:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 224 off11728 00000040:00080000:2.0:1788460587.372168:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11952 00000040:00080000:2.0:1788460587.372453:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 88 off12040 00000040:00080000:2.0:1788460587.372505:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 128 off12168 00000040:00080000:2.0:1788460587.372552:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 144 off12312 00000040:00080000:2.0:1788460587.372589:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 128 off12440 00000040:00080000:2.0:1788460587.372652:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 224 off12664 00000040:00080000:2.0:1788460587.372704:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 224 off12888 00000040:00080000:2.0:1788460587.372742:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 80 off12968 00000040:00080000:2.0:1788460587.372776:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 224 off13192 00000040:00080000:2.0:1788460587.372838:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13416 00000040:00080000:2.0:1788460587.372879:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 88 off13504 00000040:00080000:2.0:1788460587.372912:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 128 off13632 00000040:00080000:2.0:1788460587.372945:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 144 off13776 00000040:00080000:2.0:1788460587.372991:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 128 off13904 00000040:00080000:2.0:1788460587.373027:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 224 off14128 00000040:00080000:2.0:1788460587.373076:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 224 off14352 00000040:00080000:2.0:1788460587.373109:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 80 off14432 00000040:00080000:2.0:1788460587.373139:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 224 off14656 00000040:00080000:2.0:1788460587.373199:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14880 00000040:00080000:2.0:1788460587.373237:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 120 off15000 00000100:00100000:2.0:1788460587.373284:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460587.373355:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460587.373396:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650cab7ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460587.373647:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622848 00000100:00100000:3.0:1788460587.373653:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622848 00000100:00100000:3.0:1788460587.373703:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788460587.373712:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460587.373946:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482622848:12345-0@lo:502:mount.lustre.0 Request processed in 234us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460587.373953:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788460587.374624:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482622848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460587.374731:0:15899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 224 off15224 00000040:00080000:1.0:1788460587.374752:0:15899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788460587.376596:0:15909:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788460587.376619:0:15909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff964fc128cc98) 00000020:00000080:1.0:1788460587.376639:0:15909:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788460587.376714:0:15909:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650c4ec5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788460587.376718:0:15909:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650c4ec5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788460587.376721:0:15909:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c4ec5800 3 00010000:00080000:1.0:1788460587.376760:0:15909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964fc2fe5800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.132@tcp at head 00010000:00010000:3.0:1788460587.382123:0:15909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788460587.383442:0:15909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788460587.383500:0:15909:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788460587.383513:0:15909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x889bb893541b84da 00000100:00080000:3.0:1788460587.383523:0:15909:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788460587.383529:0:15909:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff964fc2fe5800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1788460587.383564:0:15909:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efdd3480 x1875336482622976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788460587.383619:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482622976:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788460587.383684:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788460587.383739:0:15909:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788460587.384147:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482622976 00000100:00100000:1.0:1788460587.384155:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482622976 00000100:00100000:1.0:1788460587.384210:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460587.384218:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482622976:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788460587.384242:0:14501:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:1.0:1788460587.384375:0:14501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x889bb893541b84e1 00000004:00100000:1.0:1788460587.384390:0:14501:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788460587.384422:0:14501:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe0800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788460587.385543:0:15909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 42 count 42 00000020:01000000:3.0:1788460587.385648:0:15899:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788460587.385660:0:15899:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788460587.385676:0:15899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460587.385697:0:15899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788460587.385757:0:15899:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788460587.385760:0:15899:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460587.385761:0:15899:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460587.385762:0:15899:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460587.385763:0:15899:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460587.385765:0:15899:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460587.385766:0:15899:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460587.385768:0:15899:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460587.385769:0:15899:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788460587.385773:0:15899:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788460587.385775:0:15899:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460587.385776:0:15899:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460587.385777:0:15899:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460587.385779:0:15899:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460587.385780:0:15899:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460587.385781:0:15899:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460587.385782:0:15899:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460587.385783:0:15899:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460587.385783:0:15899:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788460587.385804:0:15899:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788460587.385821:0:15899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482623104:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788460587.385890:0:15899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460587.386109:0:15899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fa480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460587.388782:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875336482622976:12345-0@lo:38:llog_process_th.0 Request processed in 4555us (5090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.388796:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788460587.388890:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460587.388895:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788460587.388898:0:38:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460587.388903:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1788460587.388908:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788460587.388914:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650f5cfa800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460587.388936:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650ec01df80 x1875336482623360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460587.389012:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482623488:0@lo:400:kworker.0 00000100:00100000:1.0:1788460587.389063:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.389094:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460587.389101:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482623232:0@lo:400:kworker.0 00000100:00100000:1.0:1788460587.389126:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.389150:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482623616:0@lo:400:kworker.0 00000100:00100000:1.0:1788460587.389172:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.389225:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482623488 00000100:00100000:1.0:1788460587.389233:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482623488 00000100:00100000:1.0:1788460587.389265:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482623616 00000100:00100000:1.0:1788460587.389268:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482623616 00000100:00100000:1.0:1788460587.389288:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460587.389295:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482623488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460587.389352:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482623488:12345-0@lo:400:kworker.0 Request processed in 57us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.389359:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460587.389371:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460587.389377:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482623616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460587.389407:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482623616:12345-0@lo:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.389412:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788460587.389429:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788460587.389453:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650ec01ed80 x1875336482623488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460587.389486:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482623488:0@lo:400:kworker.0 00010000:00080000:1.0:1788460587.389523:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650ec01dc00 x1875336482623616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460587.389531:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482623616:0@lo:400:kworker.0 00000100:00100000:2.0:1788460587.389790:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482623232 00000100:00100000:2.0:1788460587.389794:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482623232 00000100:00100000:2.0:1788460587.389848:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460587.389856:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482623232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460587.389896:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482623232:12345-0@lo:400:kworker.0 Request processed in 41us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.389901:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788460587.391435:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460587.391493:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788460587.391513:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482623232:0@lo:400:kworker.0 00000100:00100000:2.0:1788460587.391948:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482623104 00000100:00100000:2.0:1788460587.391955:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482623104 00000100:00100000:2.0:1788460587.392005:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788460587.392014:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:15899:x1875336482623104:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788460587.392055:0:14497:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788460587.392073:0:14497:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788460587.393784:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650efdd3480 x1875336482622976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460587.393797:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788460587.393806:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788460587.393816:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788460587.393821:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788460587.393824:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788460587.395422:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482622976:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788460587.395488:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482623360:0@lo:8:kworker.0 00000100:00100000:0.0:1788460587.395551:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460587.397685:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482623360 00000100:00100000:2.0:1788460587.397699:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482623360 00000100:00100000:2.0:1788460587.397738:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460587.397745:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3315:x1875336482623360:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788460587.397835:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3315:x1875336482623360:12345-0@lo:8:kworker.0 Request processed in 89us (2283us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788460587.397983:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788460587.397992:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460587.397996:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788460587.398000:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482623360:0@lo:8:kworker.0 00000100:00100000:2.0:1788460587.399454:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1788460587.444668:0:14497:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788460587.444686:0:14497:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788460587.444862:0:14517:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788460587.444867:0:14517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788460587.444888:0:14517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.444917:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b838a expref: 23 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.444926:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8398 expref: 23 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.444932:0:14517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b84a9 expref: 23 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.444939:0:14517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.444979:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b84a9 expref: 23 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.444994:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b84a9 expref: 23 pid: 14495 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.445021:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482623744:0@lo:104: 00000100:00100000:1.0:1788460587.445084:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460587.445149:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8398 expref: 23 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.445157:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8398 expref: 23 pid: 14496 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.445165:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482623872:0@lo:104: 00000100:00100000:1.0:1788460587.445211:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460587.445236:0:14517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b838a expref: 23 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.445244:0:14517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b838a expref: 23 pid: 14497 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.445253:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482624000:0@lo:104: 00000100:00100000:1.0:1788460587.445271:0:14517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.445281:0:14517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d9304f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460587.445683:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482623744 00000100:00100000:2.0:1788460587.445691:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482623744 00000100:00100000:2.0:1788460587.445727:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482623872 00000100:00100000:2.0:1788460587.445731:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482623872 00000100:00100000:2.0:1788460587.445739:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624000 00000100:00100000:2.0:1788460587.445741:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624000 00000100:00100000:2.0:1788460587.445753:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460587.445760:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+5:14517:x1875336482623744:12345-0@lo:104: 00010000:00010000:2.0:1788460587.445774:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.445834:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460587.445840:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+5:14517:x1875336482623744:12345-0@lo:104: Request processed in 80us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.445847:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460587.445865:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460587.445871:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+4:14517:x1875336482623872:12345-0@lo:104: 00010000:00010000:2.0:1788460587.445878:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.445920:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460587.445933:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+4:14517:x1875336482623872:12345-0@lo:104: Request processed in 63us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.445940:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460587.445953:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460587.445959:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+3:14517:x1875336482624000:12345-0@lo:104: 00010000:00010000:2.0:1788460587.445967:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.445994:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788460587.445998:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+3:14517:x1875336482624000:12345-0@lo:104: Request processed in 41us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.446003:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788460587.446018:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460587.446024:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446030:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460587.446034:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446042:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460587.446049:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460587.446054:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460587.446085:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446103:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460587.446119:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446126:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b84a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b84b0 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446141:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460587.446144:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446150:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460587.446153:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446160:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460587.446166:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460587.446171:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460587.446216:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446222:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460587.446235:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446241:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029cc00/0x889bb893541b8398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b839f expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446257:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460587.446260:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446266:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460587.446269:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446275:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460587.446281:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460587.446285:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460587.446299:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446305:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460587.446312:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446319:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f4e00/0x889bb893541b838a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8391 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446332:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460587.446334:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460587.446335:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460587.446355:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482624256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460587.446396:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460587.446425:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460587.446432:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482624384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460587.446450:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460587.446495:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624256 00000100:00100000:2.0:1788460587.446500:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624256 00010000:00010000:2.0:1788460587.446516:0:14489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8398 expref: 24 pid: 14496 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460587.446537:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624384 00000100:00100000:2.0:1788460587.446539:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624384 00010000:00010000:2.0:1788460587.446548:0:14489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b838a expref: 25 pid: 14497 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460587.446561:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460587.446567:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+25:3318:x1875336482624256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460587.446576:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460587.446580:0:14489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8398 expref: 25 pid: 14496 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446587:0:14489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8398 expref: 25 pid: 14496 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446600:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460587.446624:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+25:3318:x1875336482624256:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.446630:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460587.446642:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460587.446647:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+24:3318:x1875336482624384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460587.446660:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460587.446665:0:14489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b838a expref: 24 pid: 14497 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446672:0:14489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b838a expref: 24 pid: 14497 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460587.446681:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460587.446703:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+24:3318:x1875336482624384:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460587.446710:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460587.446756:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482624384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460587.446765:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482624256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460587.447320:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460587.447347:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482624128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460587.447387:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460587.447440:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624128 00000100:00100000:1.0:1788460587.447445:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624128 00010000:00010000:1.0:1788460587.447477:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b84a9 expref: 24 pid: 14495 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.447504:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460587.447522:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c615e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2de9e0bf-5e47-4625-abae-f266e65391be+24:3317:x1875336482624128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460587.447531:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460587.447536:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b84a9 expref: 24 pid: 14495 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447546:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b84a9 expref: 24 pid: 14495 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447560:0:14487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447568:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788460587.447582:0:14487:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003978158s 00010000:00010000:1.0:1788460587.447587:0:14487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447594:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447601:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447608:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447614:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460587.447618:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447634:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447643:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.447654:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460587.447686:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c615e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2de9e0bf-5e47-4625-abae-f266e65391be+24:3317:x1875336482624128:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.447693:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460587.447745:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482624128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460587.447770:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b84b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b84a9 expref: 23 pid: 14495 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.447781:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482623744:0@lo:104: 00010000:00010000:1.0:1788460587.447790:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029de00/0x889bb893541b839f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8398 expref: 22 pid: 14496 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.447799:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482623872:0@lo:104: 00010000:00010000:1.0:1788460587.447807:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029c200/0x889bb893541b8391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b838a expref: 21 pid: 14497 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.447814:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14517:1875336482624000:0@lo:104: 00010000:00010000:1.0:1788460587.447829:0:14517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.452284:0:14517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.452321:0:14517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460587.452328:0:14517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c3fb5000/0x889bb893541b84e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460587.478001:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:15899:x1875336482623104:12345-0@lo:253:mount.lustre.0 Request processed in 85980us (92102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460587.478015:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788460587.478160:0:15899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2de9e0bf-5e47-4625-abae-f266e65391be:15899:1875336482623104:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788460587.478210:0:15899:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788460587.478213:0:15899:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788460587.478215:0:15899:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460587.478217:0:15899:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460587.478218:0:15899:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460587.478219:0:15899:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460587.478235:0:15899:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460587.478237:0:15899:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460587.478238:0:15899:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460587.478240:0:15899:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788460587.478254:0:15899:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788460587.487832:0:15899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460587.488791:0:15899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788460587.489116:0:15899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460587.489321:0:15899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788460587.489528:0:15899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788460587.490022:0:15899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788460587.490763:0:15899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788460587.585053:0:15899:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788460587.585062:0:15899:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788460587.585101:0:15899:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788460587.585130:0:15899:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788460588.045710:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460588.556503:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460588.556526:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482624512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460588.556595:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460588.556786:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624512 00000100:00100000:1.0:1788460588.556794:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624512 00000100:00100000:1.0:1788460588.556855:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460588.556864:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482624512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460588.556902:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460588.556946:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482624512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460588.556954:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460588.556998:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482624512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788460589.069279:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788460589.325284:0:14499:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460589.325293:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c4ec5800 from 8 10000000:01000000:3.0:1788460589.325298:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460589.325352:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.325366:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.325377:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460589.325403:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482624640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460589.325637:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460589.325692:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624640 00000100:00100000:3.0:1788460589.325695:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460589.325701:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624640 00000100:00100000:0.0:1788460589.325795:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788460589.325805:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+20:14499:x1875336482624640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460589.325819:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460589.325833:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102167200/0x889bb893541b84f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b84ef expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.325856:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102167200/0x889bb893541b84f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b84ef expref: 21 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.325866:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102167200/0x889bb893541b84f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b84ef expref: 21 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.325893:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102167200, rc 0) 00000100:00100000:0.0:1788460589.325953:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482624640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460589.325960:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788460589.329148:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482624640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460589.329193:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.329208:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460589.329280:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482624768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788460589.329624:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460589.329659:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460589.329682:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624768 00000100:00100000:3.0:1788460589.329695:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624768 00000100:00100000:3.0:1788460589.329736:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788460589.329744:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482624768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460589.329764:0:14497:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460589.329779:0:14497:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460589.329782:0:14497:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788460589.329859:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482624768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460589.330409:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788460589.330469:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482624768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788460589.330504:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460589.330512:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.330522:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460589.330604:0:14499:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460589.330607:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff964fc19a9000 from 8 10000000:01000000:3.0:1788460589.330610:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460589.330634:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.330643:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.330651:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460589.330666:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482624896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460589.330703:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460589.330723:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460589.330736:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482624896 00000100:00100000:3.0:1788460589.330740:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482624896 00000100:00100000:3.0:1788460589.330760:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788460589.330767:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482624896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460589.330776:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460589.330786:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d800/0x889bb893541b8504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b84fd expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.330805:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d800/0x889bb893541b8504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b84fd expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.330813:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d800/0x889bb893541b8504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b84fd expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.330821:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d800, rc 0) 00000100:00100000:3.0:1788460589.330850:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482624896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460589.330856:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788460589.331642:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482624896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460589.331658:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460589.331667:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460589.331717:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482625024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788460589.333781:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460589.333840:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460589.335063:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625024 00000100:00100000:0.0:1788460589.335074:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625024 00000100:00100000:0.0:1788460589.335131:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788460589.335142:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482625024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788460589.335168:0:14496:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788460589.335206:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788460589.335209:0:14496:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788460589.335350:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482625024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 210us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460589.335358:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788460589.335417:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482625024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788460589.335474:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460589.335484:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.335495:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460589.335511:0:14499:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788460589.335514:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650c5014000 from 8 10000000:01000000:0.0:1788460589.335517:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788460589.335548:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.335556:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.335575:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460589.335594:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6055880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482625152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460589.335626:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460589.335654:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460589.335668:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625152 00000100:00100000:0.0:1788460589.335671:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625152 00000100:00100000:0.0:1788460589.335696:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788460589.335702:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482625152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460589.335711:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460589.335723:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff965102166200/0x889bb893541b8512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b850b expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.335745:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff965102166200/0x889bb893541b8512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b850b expref: 23 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.335757:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff965102166200/0x889bb893541b8512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b850b expref: 23 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.335766:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff965102166200, rc 0) 00000100:00100000:0.0:1788460589.335795:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482625152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460589.335801:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788460589.335976:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6055880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482625152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460589.335990:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460589.336004:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460589.336047:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6055880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482625280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788460589.336081:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460589.336111:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460589.336128:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625280 00000100:00100000:0.0:1788460589.336132:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625280 00000100:00100000:0.0:1788460589.336160:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788460589.336168:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482625280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788460589.336202:0:14496:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788460589.336215:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788460589.336218:0:14496:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788460589.336298:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482625280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460589.336306:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788460589.336847:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6055880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482625280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788460589.336925:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460589.336933:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460589.336959:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460590.095614:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460590.540968:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788460591.119787:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.141278:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788460592.652460:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460592.652467:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788460592.652470:0:37:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460592.652482:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650f5cfa800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460592.652502:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff965101d8d180 x1875336482625664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460592.652570:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482625920:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.652631:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.652687:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788460592.652693:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482625408:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.652718:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.652740:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482626048:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.652762:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.652786:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482625536:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.652810:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.652828:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460592.652834:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482625792:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.652882:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.652909:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482625664:0@lo:8:kworker.0 00000100:00100000:2.0:1788460592.652934:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.652965:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625920 00000100:00100000:2.0:1788460592.652971:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625920 00000100:00100000:2.0:1788460592.653013:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626048 00000100:00100000:2.0:1788460592.653015:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626048 00000100:00100000:2.0:1788460592.653025:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625792 00000100:00100000:2.0:1788460592.653027:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625792 00000100:00100000:2.0:1788460592.653038:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460592.653045:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482625920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.653091:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482625920:12345-0@lo:400:kworker.0 Request processed in 46us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460592.653098:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460592.653123:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460592.653129:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482626048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.653157:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482626048:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460592.653162:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460592.653172:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460592.653196:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482625792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.653225:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482625792:12345-0@lo:400:kworker.0 Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460592.653230:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460592.653246:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625408 00000100:00100000:2.0:1788460592.653249:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625408 00000100:00100000:2.0:1788460592.653271:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788460592.653277:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482625408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.653303:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482625408:12345-0@lo:400:kworker.0 Request processed in 27us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460592.653309:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788460592.653338:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625536 00000100:00100000:2.0:1788460592.653342:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625536 00000100:00100000:2.0:1788460592.653363:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482625664 00000100:00100000:2.0:1788460592.653366:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482625664 00000100:00100000:2.0:1788460592.653375:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460592.653381:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482625536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.653409:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482625536:12345-0@lo:400:kworker.0 Request processed in 28us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460592.653414:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460592.653436:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460592.653448:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3315:x1875336482625664:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788460592.653475:0:15186:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1788460592.653502:0:15186:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b8519 00002000:00100000:2.0:1788460592.653516:0:15186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9650c2e41800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788460592.653520:0:15186:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788460592.653523:0:15186:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788460592.653845:0:15186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788460592.653867:0:15186:0:(import.c:65:import_set_state_nolock()) ffff9650c2e43800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460592.653908:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875336482625664:12345-0@lo:8:kworker.0 Request processed in 460us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460592.653915:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788460592.653939:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460592.653944:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788460592.654224:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8d180 x1875336482625664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788460592.654240:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788460592.654247:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788460592.654251:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788460592.654253:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788460592.654265:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788460592.654269:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482625664:0@lo:8:kworker.0 00000100:00100000:2.0:1788460592.654381:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460592.654390:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482626176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460592.654418:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.654483:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626176 00000100:00100000:2.0:1788460592.654489:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626176 00000100:00100000:2.0:1788460592.654527:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460592.654534:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482626176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460592.654554:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460592.654591:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482626176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460592.654597:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788460592.654615:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788460592.654620:0:14526:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788460592.654638:0:14526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875336482626304:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788460592.654662:0:14526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.654677:0:14526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c45676c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788460592.654698:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8d180 x1875336482626176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460592.654713:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482626176:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788460592.654739:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8e680 x1875336482625792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460592.654748:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482625792:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.654758:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482625536:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.654930:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482625408:0@lo:400:kworker.0 00010000:00080000:2.0:1788460592.654943:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8e300 x1875336482626048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460592.654952:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482626048:0@lo:400:kworker.0 00010000:00080000:2.0:1788460592.654962:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff965101d8c380 x1875336482625920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460592.654977:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482625920:0@lo:400:kworker.0 00000100:00100000:2.0:1788460592.655153:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626304 00000100:00100000:2.0:1788460592.655158:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626304 00000100:00100000:2.0:1788460592.655208:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788460592.655216:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14526:x1875336482626304:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788460592.655694:0:14525:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788460592.656087:0:14525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 465891906932ns, next at 0ns, rc = 0 00002000:00080000:1.0:1788460592.677346:0:15186:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788460592.677357:0:15186:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788460592.677363:0:15186:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788460592.700777:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460592.700790:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700808:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1788460592.700813:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460592.700820:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700852:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700862:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700869:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700904:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.700917:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.700923:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700931:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.700935:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700946:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700963:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700971:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8520 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.700990:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.700991:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.700993:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460592.703123:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460592.703136:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.703152:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1788460592.703162:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460592.703168:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.703197:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.703209:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.703217:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.703244:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460592.703310:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460592.703319:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.703330:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460592.703335:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.703359:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.703380:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.703389:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7291e88/0x889bb893541b8527 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.703412:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.703415:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.703418:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460592.704123:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460592.704131:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.704144:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1788460592.704148:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460592.704153:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.704164:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.704172:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.704217:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.704238:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460592.704413:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460592.704421:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.704441:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460592.704446:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.704456:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.704471:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.704502:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a550be2a/0x889bb893541b852e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.704520:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.704522:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.704524:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460592.712558:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460592.712573:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.712590:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1788460592.712596:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460592.712603:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.712620:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.712632:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.712641:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.712669:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460592.712691:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460592.712700:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.712711:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460592.712715:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.712725:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.712745:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.712752:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6a434e/0x889bb893541b8535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.712774:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.712776:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.712778:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460592.713213:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460592.713220:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713237:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1788460592.713240:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460592.713245:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713255:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713264:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713274:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.713359:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.713707:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.713714:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713724:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.713728:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713738:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713764:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713772:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd736f1e/0x889bb893541b853c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.713793:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.713795:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.713797:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.713826:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.713834:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.713844:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.713847:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.713852:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.713862:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.713869:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.713876:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.713898:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.714570:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.714578:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.714588:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102166c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.714592:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.714602:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.714616:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.714624:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000052570dc/0x889bb893541b8543 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.714654:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.714656:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.714658:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.714830:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.714837:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.714846:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.714850:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.714855:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.714877:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.714886:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.714893:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.714947:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460592.716133:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.716143:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.716159:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.716162:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.716168:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.716214:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.716225:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.716256:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718005:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460592.718018:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718031:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.718037:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718048:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718079:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718087:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b749b30/0x889bb893541b854a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718108:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.718121:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718128:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102166400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.718138:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718146:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718157:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.718166:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.718168:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.718169:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.733344:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460592.733360:0:15186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007969413e/0x889bb893541b8551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460592.734217:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.734227:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734243:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.734248:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.734255:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734270:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734282:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734290:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734321:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460592.734332:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460592.734337:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734345:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460592.734349:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734359:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734376:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734383:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074126c31/0x889bb893541b8558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.734396:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.734400:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.734403:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.734405:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.734782:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.734789:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734798:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.734807:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.734812:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734821:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734828:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734835:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.734856:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.734876:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.734884:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.734895:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.734899:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.734907:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.734921:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.734928:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b855f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.734955:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.734957:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.734960:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.735443:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.735449:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735459:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.735463:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.735468:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735477:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735485:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735499:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735517:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.735623:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.735629:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.735639:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.735644:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.735653:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.735668:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.735675:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092cdf38b/0x889bb893541b8566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.735695:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.735696:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.735700:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.735905:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.735912:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735921:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.735924:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.735928:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735937:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735945:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735952:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.735970:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.736389:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.736396:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.736885:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.736889:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.736898:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.736915:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.736922:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adf139db/0x889bb893541b856d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.736945:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.736948:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.736950:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.737340:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.737348:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.737366:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.737370:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.737375:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.737386:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.737395:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.737402:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.737433:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.737488:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.737495:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.737502:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.737506:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.737514:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.737532:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.737610:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b2d9dc/0x889bb893541b8574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.737628:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.737630:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.737632:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.738046:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.738053:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.738063:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.738067:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.738071:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.738081:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.738100:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.738108:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.738553:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.738622:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.738630:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.738639:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5aa00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.738644:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.738652:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.738666:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.738674:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cece49ca/0x889bb893541b857b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.738707:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.738709:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.738712:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.739010:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.739017:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.739025:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.739029:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.739033:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.739043:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.739051:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.739058:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.739094:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.739486:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.739493:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.739501:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ae00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.739506:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.739515:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.739530:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.739537:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf21d7b8/0x889bb893541b8582 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.739552:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.739554:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.739556:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.740977:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.740989:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.741003:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.741007:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.741012:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.741025:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.741034:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.741041:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.741061:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788460592.741797:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788460592.742121:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.742129:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.742152:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.742157:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.742167:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.742200:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.742209:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8b0585e/0x889bb893541b8589 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.742243:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.742245:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.742248:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.744781:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.744795:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.744810:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.744821:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.744827:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.744842:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.744854:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.744861:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.744881:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.745219:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.745290:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.745358:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5be00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.745363:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.745373:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.745398:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.745405:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf8da976/0x889bb893541b8590 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.745432:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.745434:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.745436:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.746008:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.746016:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.746027:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.746030:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.746035:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.746046:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.746054:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.746618:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.746638:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460592.747126:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.747133:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747145:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.747149:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.747154:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747165:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747173:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747199:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747219:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788460592.747245:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460592.747251:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747265:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ac00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460592.747269:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747278:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747294:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747313:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b47e414d/0x889bb893541b8597 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747332:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460592.747336:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747342:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5b200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460592.747345:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747351:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747361:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747376:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3382621/0x889bb893541b859e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747391:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.747393:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.747394:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.747841:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.747848:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747858:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.747862:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.747867:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747878:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747887:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747896:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747913:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460592.747922:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460592.747930:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747938:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460592.747941:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747949:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747961:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747969:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda8bcbe/0x889bb893541b85a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.747983:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.747986:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.747987:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.753032:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.753048:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.755285:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.755298:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.755459:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.755622:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.755635:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.755644:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.755679:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460592.755985:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460592.755994:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.756005:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460592.756010:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.756021:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.756047:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.756056:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054a7d0a4/0x889bb893541b85ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.756086:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460592.756089:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460592.756091:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.758910:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.758925:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.758941:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.758946:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.758952:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.758965:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.758976:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.758996:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.759018:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460592.759557:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.759565:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.759574:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.759578:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.759589:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.759607:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.759615:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051de4776/0x889bb893541b85b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.759649:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.759651:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.759653:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460592.762697:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460592.763653:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.763663:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.763680:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.763684:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.763690:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.763705:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.763715:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.763723:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.763742:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460592.764223:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.764230:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.764247:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788460592.764250:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.764254:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.764264:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.764272:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.764279:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.764987:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788460592.765950:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.765960:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.765974:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1788460592.765978:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.765983:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.765997:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.766018:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.766026:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.770988:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788460592.771005:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.771042:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460592.771047:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.771058:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.771079:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.771086:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec2a884c/0x889bb893541b85ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771433:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460592.771442:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771453:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.771457:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771466:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771545:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771553:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948e03a9/0x889bb893541b85c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771571:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460592.771576:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771584:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460592.771595:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.771596:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460592.771600:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460592.771603:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.771614:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771625:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.771633:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.771635:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.771637:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460592.780934:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460592.780949:0:15186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050dd65b/0x889bb893541b85c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460592.781628:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.781637:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.781649:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1788460592.781654:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.781659:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.781672:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.781682:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.781702:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.781727:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460592.782115:0:15186:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460592.782121:0:15186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.782130:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1788460592.782133:0:15186:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460592.782137:0:15186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.782146:0:15186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.782153:0:15186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.782160:0:15186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460592.782168:0:15186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788460592.782360:0:15186:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788460592.782460:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14526:x1875336482626304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 127241us (127794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460592.782480:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788460592.782563:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460592.782572:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.782583:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460592.782587:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.782596:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.782613:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.782628:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb7c44e8/0x889bb893541b85cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.782645:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460592.782649:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.782652:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460592.782653:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460592.782656:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.782664:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460592.782668:0:14491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.782677:0:14491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.782689:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.782697:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000453a16d0/0x889bb893541b85d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460592.782722:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.782724:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460592.782725:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460592.782756:0:14526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875336482626304:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788460592.782772:0:14526:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788460592.782816:0:14526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875336482626432:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788460592.782851:0:14526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460592.782900:0:14526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c45676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460592.784551:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626432 00000100:00100000:0.0:1788460592.784564:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626432 00000100:00100000:0.0:1788460592.784626:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460592.784636:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14526:x1875336482626432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788460592.784683:0:15184:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788460592.795776:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14526:x1875336482626432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11134us (12916us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788460592.795789:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460592.795973:0:14526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14526:1875336482626432:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788460592.795989:0:14526:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788460593.167547:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460593.676454:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482626560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460593.676514:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460593.676680:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626560 00000100:00100000:1.0:1788460593.676687:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626560 00000100:00100000:1.0:1788460593.676728:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460593.676736:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482626560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460593.676766:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460593.676803:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482626560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460593.676810:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460593.676896:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482626560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788460594.202781:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788460594.667115:0:16254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788460595.212688:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460596.236479:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460597.152919:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460597.153013:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462704896 00000100:00100000:0.0:1788460597.153023:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462704896 00000100:00100000:0.0:1788460597.153083:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:0.0:1788460597.153091:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2378:x1875336462704896:12345-192.168.203.32@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788460597.153119:0:14497:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from 30b68111-22c2-4c96-9a8f-dff9e84f1a4c@192.168.203.32@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1788460597.153148:0:14497:0:(genops.c:1385:class_connect()) connect: client 30b68111-22c2-4c96-9a8f-dff9e84f1a4c, cookie 0x889bb893541b85dd 00000100:00080000:0.0:1788460597.153331:0:14497:0:(import.c:65:import_set_state_nolock()) ffff964fc1e84800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460597.153411:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+5:2378:x1875336462704896:12345-192.168.203.32@tcp:250:mount.lustre.0 Request processed in 319us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.153420:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:2.0:1788460597.168661:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460597.169035:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705024 00000100:00100000:0.0:1788460597.169054:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705024 00000100:00100000:0.0:1788460597.169114:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:0.0:1788460597.169124:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+5:13806:x1875336462705024:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788460597.169140:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460597.169166:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea4600/0x889bb893541b85e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d164c expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460597.169231:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea4600/0x889bb893541b85e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d164c expref: 6 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460597.169244:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea4600/0x889bb893541b85e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d164c expref: 6 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460597.169253:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea4600, rc 0) 00000100:00100000:0.0:1788460597.169302:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+6:13806:x1875336462705024:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 180us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.169310:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:3.0:1788460597.171841:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.172011:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705152 00000100:00100000:2.0:1788460597.172021:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705152 00000100:00100000:2.0:1788460597.172086:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:2.0:1788460597.172098:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+6:13806:x1875336462705152:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460597.172483:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+6:13806:x1875336462705152:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 377us (640us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460597.172493:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:1.0:1788460597.183123:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.183349:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705280 00000100:00100000:2.0:1788460597.183359:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705280 00000100:00100000:2.0:1788460597.183434:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1788460597.183445:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+6:13806:x1875336462705280:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788460597.183461:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460597.183489:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec009e00/0x889bb893541b85eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1653 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460597.183518:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009e00/0x889bb893541b85eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1653 expref: 7 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460597.183530:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec009e00/0x889bb893541b85eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1653 expref: 7 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460597.183539:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009e00, rc 0) 00000100:00100000:2.0:1788460597.183598:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+7:13806:x1875336462705280:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 155us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.183605:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:3.0:1788460597.190876:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460597.190943:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705408 00000100:00100000:0.0:1788460597.190953:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705408 00000100:00100000:0.0:1788460597.191012:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:0.0:1788460597.191023:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+7:13806:x1875336462705408:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788460597.191430:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13806:x1875336462705408:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 407us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.191438:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:3.0:1788460597.194557:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.194656:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705536 00000100:00100000:2.0:1788460597.194665:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705536 00000100:00100000:2.0:1788460597.194718:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:2.0:1788460597.194728:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13806:x1875336462705536:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788460597.194946:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13806:x1875336462705536:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 218us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.194960:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:1.0:1788460597.204587:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.205935:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705664 00000100:00100000:2.0:1788460597.205949:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705664 00000100:00100000:2.0:1788460597.206069:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:2.0:1788460597.206081:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13824:x1875336462705664:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460597.206456:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13824:x1875336462705664:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 375us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.206465:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:2.0:1788460597.231635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460597.231716:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705792 00000100:00100000:0.0:1788460597.231728:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705792 00000100:00100000:0.0:1788460597.231785:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:0.0:1788460597.231796:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13824:x1875336462705792:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788460597.232091:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13824:x1875336462705792:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 296us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.232100:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:3.0:1788460597.235132:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.235281:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462705920 00000100:00100000:2.0:1788460597.235291:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462705920 00000100:00100000:2.0:1788460597.235350:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:2.0:1788460597.235360:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:13806:x1875336462705920:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788460597.235377:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460597.235405:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec009a00/0x889bb893541b85f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d167d expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460597.235433:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009a00/0x889bb893541b85f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d167d expref: 9 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460597.235446:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec009a00/0x889bb893541b85f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d167d expref: 9 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460597.235456:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009a00, rc 0) 00000100:00100000:2.0:1788460597.235524:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+9:13806:x1875336462705920:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 166us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.235550:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1788460597.238303:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.238407:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706048 00000100:00100000:2.0:1788460597.238417:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706048 00000100:00100000:2.0:1788460597.238464:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:2.0:1788460597.238473:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+9:13806:x1875336462706048:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788460597.238499:0:14497:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788460597.238535:0:14497:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788460597.238539:0:14497:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788460597.238542:0:14497:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788460597.238545:0:14497:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788460597.240289:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+9:13806:x1875336462706048:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 1799us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.240302:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:1.0:1788460597.243379:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460597.243519:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706176 00000100:00100000:0.0:1788460597.243529:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706176 00000100:00100000:0.0:1788460597.243582:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:0.0:1788460597.243591:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+9:13806:x1875336462706176:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788460597.243606:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460597.243622:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1684 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460597.243648:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 10 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460597.243659:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 10 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460597.243668:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5000, rc 0) 00000100:00100000:0.0:1788460597.243720:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13806:x1875336462706176:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 130us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.243727:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:1.0:1788460597.253116:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.253226:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706304 00000100:00100000:2.0:1788460597.253237:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706304 00000100:00100000:2.0:1788460597.253298:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:2.0:1788460597.253308:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13806:x1875336462706304:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460597.253745:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13806:x1875336462706304:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 436us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.253753:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:3.0:1788460597.256232:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.256369:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706432 00000100:00100000:2.0:1788460597.256379:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706432 00000100:00100000:2.0:1788460597.256432:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:2.0:1788460597.256442:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13806:x1875336462706432:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788460597.256670:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13806:x1875336462706432:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 228us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.256686:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:1.0:1788460597.260011:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460597.260114:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706560 00000100:00100000:0.0:1788460597.260124:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706560 00000100:00100000:0.0:1788460597.260229:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:0.0:1788460597.260239:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13827:x1875336462706560:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788460597.260495:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13827:x1875336462706560:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 256us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.260504:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00010000:00010000:1.0:1788460597.260938:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460597.275844:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460597.275918:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706688 00000100:00100000:0.0:1788460597.275928:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706688 00000100:00100000:0.0:1788460597.275996:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:0.0:1788460597.276007:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13827:x1875336462706688:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788460597.276289:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13827:x1875336462706688:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 283us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.276298:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 103 00000100:00100000:3.0:1788460597.284635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.285954:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706816 00000100:00100000:2.0:1788460597.285967:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706816 00000100:00100000:2.0:1788460597.287148:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1788460597.287160:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2378:x1875336462706816:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788460597.287207:0:14503:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from 6e4fcceb-7a26-44ed-a31b-b309e7102e93@192.168.203.32@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1788460597.287256:0:14503:0:(genops.c:1385:class_connect()) connect: client 6e4fcceb-7a26-44ed-a31b-b309e7102e93, cookie 0x889bb893541b8600 00000004:00100000:2.0:1788460597.287293:0:14503:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788460597.287300:0:14503:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788460597.341789:0:14503:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460597.341950:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:2378:x1875336462706816:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 54789us (57322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460597.341962:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460597.349216:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.349443:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462706944 00000100:00100000:2.0:1788460597.349454:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462706944 00000100:00100000:1.0:1788460597.349527:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.349622:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707072 00000100:00100000:2.0:1788460597.349626:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707072 00000100:00100000:2.0:1788460597.349644:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1788460597.349653:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:0:x1875336462706944:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788460597.349701:0:14501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788460597.349783:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:0:x1875336462706944:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 129us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.349790:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1788460597.349809:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1788460597.349826:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:13806:x1875336462707072:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788460597.349838:0:14501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788460597.349860:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:13806:x1875336462707072:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.349867:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00080000:3.0:1788460597.351447:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460597.361256:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460597.361491:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707200 00000100:00100000:2.0:1788460597.361502:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707200 00000100:00100000:2.0:1788460597.361563:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460597.361572:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:13806:x1875336462707200:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788460597.361664:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:13806:x1875336462707200:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 93us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.361672:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1788460597.364578:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460597.364620:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460597.364660:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460597.364779:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707584 00000100:00100000:1.0:1788460597.364788:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707584 00000100:00100000:1.0:1788460597.364848:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1788460597.364858:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:13806:x1875336462707584:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788460597.365413:0:14504:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 477us 00000100:00100000:2.0:1788460597.368713:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707328 00000100:00100000:2.0:1788460597.368727:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707328 00000100:00100000:2.0:1788460597.368767:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707456 00000100:00100000:2.0:1788460597.368771:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707456 00000100:00100000:2.0:1788460597.368789:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460597.368797:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2378:x1875336462707328:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788460597.368843:0:15187:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from 6e4fcceb-7a26-44ed-a31b-b309e7102e93@192.168.203.32@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1788460597.368878:0:15187:0:(genops.c:1385:class_connect()) connect: client 6e4fcceb-7a26-44ed-a31b-b309e7102e93, cookie 0x889bb893541b8607 00002000:00100000:2.0:1788460597.368890:0:15187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e4fcceb-7a26-44ed-a31b-b309e7102e93/ffff9650c2e42800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788460597.368913:0:15187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788460597.369402:0:15187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788460597.369435:0:15187:0:(import.c:65:import_set_state_nolock()) ffff9650c2e44000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460597.369507:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:2378:x1875336462707328:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 709us (4938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.369515:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460597.369540:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1788460597.369544:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2378:x1875336462707456:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788460597.369561:0:15187:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from 6e4fcceb-7a26-44ed-a31b-b309e7102e93@192.168.203.32@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1788460597.369589:0:15187:0:(genops.c:1385:class_connect()) connect: client 6e4fcceb-7a26-44ed-a31b-b309e7102e93, cookie 0x889bb893541b860e 00002000:00100000:2.0:1788460597.369595:0:15187:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e4fcceb-7a26-44ed-a31b-b309e7102e93/ffff9650c2e41000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788460597.369612:0:15187:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788460597.369740:0:15187:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788460597.369758:0:15187:0:(import.c:65:import_set_state_nolock()) ffff9650c2e42000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460597.369784:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:2378:x1875336462707456:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 237us (5163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.369791:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000004:00200000:3.0:1788460597.396942:0:14504:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788460597.397079:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:13806:x1875336462707584:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 32217us (32412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460597.397096:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1788460597.689870:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460597.690296:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707712 00000100:00100000:1.0:1788460597.690306:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707712 00000100:00100000:1.0:1788460597.690359:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1788460597.690368:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:13848:x1875336462707712:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:1.0:1788460597.690388:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460597.690421:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4400/0x889bb893541b8615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d16ae expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460597.690483:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b861c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460597.690505:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b861c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460597.690520:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b861c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460597.690554:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788460597.690558:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460597.690591:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b861c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460597.690639:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4400/0x889bb893541b8615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ae expref: 8 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460597.690685:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b861c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ae expref: 7 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460597.690692:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:1.0:1788460597.690695:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460597.690698:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4200, rc 0) 00000100:00100000:1.0:1788460597.690777:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:13848:x1875336462707712:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 409us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460597.690785:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1788460597.773824:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482626816:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.773902:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460597.773962:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482627328:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.773997:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460597.774024:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788460597.774044:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482626688:0@lo:400:kworker.0 00000100:00100000:2.0:1788460597.774076:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482626944:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.774077:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460597.774108:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482627200:0@lo:400:kworker.0 00000100:00100000:2.0:1788460597.774117:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460597.774160:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460597.774166:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482627072:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.774482:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460597.774917:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626688 00000100:00100000:3.0:1788460597.774927:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626688 00000100:00100000:3.0:1788460597.774989:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788460597.774998:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3317:x1875336482626688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460597.775078:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3317:x1875336482626688:12345-0@lo:400:kworker.0 Request processed in 80us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460597.775085:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788460597.775411:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627328 00000100:00100000:0.0:1788460597.775416:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627328 00000100:00100000:3.0:1788460597.775421:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626816 00000100:00100000:3.0:1788460597.775426:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626816 00000100:00100000:0.0:1788460597.775462:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627200 00000100:00100000:0.0:1788460597.775466:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627200 00000100:00100000:3.0:1788460597.775470:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482626944 00000100:00100000:3.0:1788460597.775475:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482626944 00000100:00100000:0.0:1788460597.775481:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460597.775492:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482626816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460597.775495:0:15184:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788460597.775504:0:15184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1788460597.775520:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460597.775524:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460597.775527:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460597.775540:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482626816:12345-0@lo:400:kworker.0 Request processed in 50us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.775547:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460597.775561:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460597.775567:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482626944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460597.775594:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482626944:12345-0@lo:400:kworker.0 Request processed in 27us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.775600:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788460597.775622:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460597.775637:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460597.775642:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482627328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460597.775670:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482627328:12345-0@lo:400:kworker.0 Request processed in 27us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.775676:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460597.775695:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460597.775701:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482627200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460597.775731:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482627200:12345-0@lo:400:kworker.0 Request processed in 30us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460597.775736:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460597.775768:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460597.775780:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482627456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460597.775813:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460597.776214:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482626688:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.776228:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482627200:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.776239:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482626816:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.776249:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482627328:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.776294:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627456 00000100:00100000:1.0:1788460597.776298:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627456 00000100:00100000:1.0:1788460597.776327:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460597.776335:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482627456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460597.776352:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460597.776408:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482627456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460597.776411:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460597.776419:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460597.776458:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482626944:0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.776465:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627072 00000100:00100000:1.0:1788460597.776470:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627072 00000100:00100000:1.0:1788460597.776493:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460597.776502:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482627072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460597.776543:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482627072:12345-0@lo:400:kworker.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460597.776549:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460597.776576:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec01df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482627072:0@lo:400:kworker.0 00000100:00100000:2.0:1788460597.776641:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482627456:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788460597.892224:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788460597.892672:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000001:00100000:2.0:1788460597.892679:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788460598.284472:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460598.798996:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460598.799030:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482627584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460598.799101:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460598.799321:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627584 00000100:00100000:1.0:1788460598.799329:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627584 00000100:00100000:1.0:1788460598.799394:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460598.799405:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482627584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460598.799439:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460598.799490:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482627584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460598.799497:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460598.799597:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482627584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460599.309144:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788460599.367947:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000100:00100000:3.0:1788460600.078157:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.079271:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707840 00000100:00100000:2.0:1788460600.079284:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707840 00000100:00100000:2.0:1788460600.079386:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1788460600.079399:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:13901:x1875336462707840:12345-192.168.203.32@tcp:41:lfs.0 00000004:00000024:2.0:1788460600.079457:0:14501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788460600.079571:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:13901:x1875336462707840:12345-192.168.203.32@tcp:41:lfs.0 Request processed in 176us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.079579:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:0.0:1788460600.080002:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460600.084993:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460600.085556:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462707968 00000100:00100000:1.0:1788460600.085628:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462707968 00000100:00100000:1.0:1788460600.085752:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460600.085763:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:13901:x1875336462707968:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:1.0:1788460600.085787:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460600.085892:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:13901:x1875336462707968:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 131us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460600.085899:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00080000:0.0:1788460600.087423:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460600.090165:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460600.090819:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708096 00000100:00100000:3.0:1788460600.090830:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708096 00000100:00100000:3.0:1788460600.090904:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1788460600.090915:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:13901:x1875336462708096:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:3.0:1788460600.090954:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460600.091045:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:13901:x1875336462708096:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 132us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460600.091053:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00080000:0.0:1788460600.093545:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460600.331922:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.332049:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708224 00000100:00100000:2.0:1788460600.332060:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708224 00000100:00100000:2.0:1788460600.332116:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:2.0:1788460600.332126:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:13932:x1875336462708224:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788460600.332143:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460600.332162:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec009c00/0x889bb893541b8623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d16b5 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.332229:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009c00/0x889bb893541b8623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16b5 expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.332240:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec009c00/0x889bb893541b8623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16b5 expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.332248:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009c00, rc 0) 00000100:00100000:2.0:1788460600.332308:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+11:13932:x1875336462708224:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 183us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.332315:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 105 00010000:00010000:2.0:1788460600.332984:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460600.337749:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460600.337891:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708352 00000100:00100000:0.0:1788460600.337901:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708352 00000100:00100000:0.0:1788460600.337959:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:0.0:1788460600.337969:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+11:13932:x1875336462708352:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788460600.338358:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+11:13932:x1875336462708352:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 388us (616us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460600.338366:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:1.0:1788460600.341060:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460600.341141:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708480 00000100:00100000:3.0:1788460600.341152:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708480 00000100:00100000:3.0:1788460600.341228:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:3.0:1788460600.341238:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fea55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+11:13932:x1875336462708480:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460600.341264:0:14496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460600.341280:0:14496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029ce00/0x889bb893541b862a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d16bc expref: -99 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460600.341305:0:14496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029ce00/0x889bb893541b862a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16bc expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460600.341315:0:14496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029ce00/0x889bb893541b862a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16bc expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460600.341323:0:14496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029ce00, rc 0) 00000100:00100000:3.0:1788460600.341385:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fea55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13932:x1875336462708480:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460600.341391:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:3.0:1788460600.344746:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.350619:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708608 00000100:00100000:2.0:1788460600.350637:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708608 00000100:00100000:2.0:1788460600.350715:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:2.0:1788460600.350726:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13932:x1875336462708608:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460600.351038:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13932:x1875336462708608:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 313us (6300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.351048:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:1.0:1788460600.359966:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460600.362594:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708736 00000100:00100000:0.0:1788460600.362608:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708736 00000100:00100000:0.0:1788460600.362678:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:0.0:1788460600.362688:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13932:x1875336462708736:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788460600.362990:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13932:x1875336462708736:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 303us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460600.363000:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:1.0:1788460600.365868:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460600.365952:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708864 00000100:00100000:3.0:1788460600.365962:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708864 00000100:00100000:3.0:1788460600.366012:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:3.0:1788460600.366022:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13939:x1875336462708864:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460600.366410:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13939:x1875336462708864:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 388us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460600.366419:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:3.0:1788460600.412554:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.412669:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462708992 00000100:00100000:2.0:1788460600.412680:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462708992 00000100:00100000:2.0:1788460600.412746:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:2.0:1788460600.412756:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13939:x1875336462708992:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460600.413023:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13939:x1875336462708992:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 267us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.413031:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:1.0:1788460600.422387:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460600.422478:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462709120 00000100:00100000:0.0:1788460600.422488:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462709120 00000100:00100000:0.0:1788460600.422543:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:0.0:1788460600.422564:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13932:x1875336462709120:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788460600.422584:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460600.422603:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea5200/0x889bb893541b8631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d16e6 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460600.422630:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea5200/0x889bb893541b8631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16e6 expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460600.422642:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea5200/0x889bb893541b8631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16e6 expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460600.422651:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5200, rc 0) 00000100:00100000:0.0:1788460600.422715:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13932:x1875336462709120:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460600.422722:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:1.0:1788460600.441157:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460600.441435:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462709248 00000100:00100000:3.0:1788460600.441446:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462709248 00000100:00100000:3.0:1788460600.441502:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:3.0:1788460600.441512:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13932:x1875336462709248:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788460600.441537:0:14496:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788460600.441561:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460600.441565:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788460600.441568:0:14496:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788460600.441571:0:14496:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788460600.447591:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13932:x1875336462709248:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 6070us (6434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.447605:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:1.0:1788460600.461497:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.461593:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462709376 00000100:00100000:2.0:1788460600.461604:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462709376 00000100:00100000:2.0:1788460600.461660:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:2.0:1788460600.461670:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13932:x1875336462709376:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788460600.461696:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460600.461714:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d16ed expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.461743:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.461755:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.461783:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008800, rc 0) 00000100:00100000:2.0:1788460600.461850:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13932:x1875336462709376:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 181us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.461865:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:1.0:1788460600.465658:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.465758:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462709504 00000100:00100000:2.0:1788460600.465768:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462709504 00000100:00100000:2.0:1788460600.465828:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:2.0:1788460600.465836:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13932:x1875336462709504:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460600.467250:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13932:x1875336462709504:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 1406us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.467262:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:3.0:1788460600.471035:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460600.471229:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462709632 00000100:00100000:0.0:1788460600.471238:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462709632 00000100:00100000:0.0:1788460600.471306:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:0.0:1788460600.471316:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13932:x1875336462709632:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788460600.471971:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13932:x1875336462709632:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 653us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460600.471981:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:1.0:1788460600.488732:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.489736:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462709760 00000100:00100000:2.0:1788460600.489747:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462709760 00000100:00100000:2.0:1788460600.489805:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:2.0:1788460600.489821:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13944:x1875336462709760:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460600.490108:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13944:x1875336462709760:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 292us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.490117:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:1.0:1788460600.515616:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460600.515785:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462709888 00000100:00100000:0.0:1788460600.515805:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462709888 00000100:00100000:0.0:1788460600.515890:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:0.0:1788460600.515901:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13944:x1875336462709888:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788460600.516165:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13944:x1875336462709888:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 265us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460600.516172:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 118 00000100:00100000:3.0:1788460600.519824:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460600.519987:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710016 00000100:00100000:1.0:1788460600.519997:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710016 00000100:00100000:1.0:1788460600.520044:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460600.520052:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2378:x1875336462710016:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788460600.520081:0:14503:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from cc6eb25b-f5fb-4afa-a165-3499bc737f69@192.168.203.32@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1788460600.520117:0:14503:0:(genops.c:1385:class_connect()) connect: client cc6eb25b-f5fb-4afa-a165-3499bc737f69, cookie 0x889bb893541b863f 00000004:00100000:1.0:1788460600.520147:0:14503:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788460600.520300:0:14503:0:(import.c:65:import_set_state_nolock()) ffff9650fde60800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460600.520389:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2378:x1875336462710016:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 335us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460600.520411:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460600.521690:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460600.521724:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460600.521749:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460600.521834:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710400 00000100:00100000:3.0:1788460600.521842:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710400 00000100:00100000:3.0:1788460600.521890:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460600.521899:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2380:x1875336462710400:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460600.521967:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2380:x1875336462710400:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 59us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460600.521975:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1788460600.522737:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710656 00000100:00100000:2.0:1788460600.522745:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710656 00000100:00100000:2.0:1788460600.522784:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710528 00000100:00100000:2.0:1788460600.522787:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710528 00000100:00100000:1.0:1788460600.522910:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460600.522920:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462710656:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460600.522978:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462710656:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 60us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460600.522986:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460600.523002:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460600.523008:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462710528:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460600.523030:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462710528:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460600.523036:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1788460600.555924:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460600.557425:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710144 00000100:00100000:1.0:1788460600.557448:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710144 00000100:00100000:1.0:1788460600.557540:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1788460600.557551:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:0:x1875336462710144:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788460600.557588:0:14503:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788460600.557682:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:0:x1875336462710144:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 132us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460600.557690:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00080000:0.0:1788460600.558570:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460600.562299:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.562756:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710272 00000100:00100000:2.0:1788460600.562767:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710272 00000100:00100000:2.0:1788460600.562843:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1788460600.562867:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:13932:x1875336462710272:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788460600.562901:0:14501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788460600.562974:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:13932:x1875336462710272:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 110us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.562982:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1788460600.568472:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460600.568567:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710784 00000100:00100000:3.0:1788460600.568576:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710784 00000100:00100000:3.0:1788460600.568644:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1788460600.568656:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:13932:x1875336462710784:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788460600.568751:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:13932:x1875336462710784:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460600.568758:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1788460600.574703:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.574883:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711168 00000100:00100000:2.0:1788460600.574894:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711168 00000100:00100000:2.0:1788460600.574949:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1788460600.574967:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:13932:x1875336462711168:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788460600.575067:0:14505:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788460600.575157:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:13932:x1875336462711168:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 199us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.575165:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1788460600.578137:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460600.578223:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460600.578437:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462710912 00000100:00100000:3.0:1788460600.578447:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462710912 00000100:00100000:3.0:1788460600.578485:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711040 00000100:00100000:3.0:1788460600.578487:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711040 00000100:00100000:3.0:1788460600.578507:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1788460600.578515:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2378:x1875336462710912:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788460600.578547:0:15184:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from cc6eb25b-f5fb-4afa-a165-3499bc737f69@192.168.203.32@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788460600.578578:0:15184:0:(genops.c:1385:class_connect()) connect: client cc6eb25b-f5fb-4afa-a165-3499bc737f69, cookie 0x889bb893541b8646 00002000:00100000:3.0:1788460600.578589:0:15184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cc6eb25b-f5fb-4afa-a165-3499bc737f69/ffff9650fc7a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460600.578601:0:15184:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460600.578871:0:15184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788460600.578901:0:15184:0:(import.c:65:import_set_state_nolock()) ffff9650fc7a3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460600.579167:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2378:x1875336462710912:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 649us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460600.579175:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1788460600.579227:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1788460600.579232:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2378:x1875336462711040:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788460600.579261:0:15184:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from cc6eb25b-f5fb-4afa-a165-3499bc737f69@192.168.203.32@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788460600.579281:0:15184:0:(genops.c:1385:class_connect()) connect: client cc6eb25b-f5fb-4afa-a165-3499bc737f69, cookie 0x889bb893541b864d 00002000:00100000:3.0:1788460600.579287:0:15184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cc6eb25b-f5fb-4afa-a165-3499bc737f69/ffff9650fc7a6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460600.579294:0:15184:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460600.580674:0:15184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788460600.580712:0:15184:0:(import.c:65:import_set_state_nolock()) ffff9650fc7a6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460600.580766:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2378:x1875336462711040:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 1531us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460600.580790:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1788460600.766494:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460600.767967:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711296 00000100:00100000:2.0:1788460600.767980:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711296 00000100:00100000:2.0:1788460600.768050:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1788460600.768062:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:13965:x1875336462711296:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:2.0:1788460600.768083:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460600.768107:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b8654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1717 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.768172:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.768222:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.768251:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460600.768288:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460600.768292:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460600.768312:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.768338:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009400/0x889bb893541b8654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 8 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.768357:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 7 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460600.768365:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:2.0:1788460600.768378:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460600.768383:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009000, rc 0) 00000100:00100000:2.0:1788460600.768461:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+7:13965:x1875336462711296:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 401us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460600.768469:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000040:00080000:3.0:1788460600.780869:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788460601.356308:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460602.389507:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788460602.479154:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc6eb25b-f5fb-4afa-a165-3499bc737f69 00000001:00100000:1.0:1788460602.479168:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000100:00100000:0.0:1788460602.893452:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482627968:0@lo:400:kworker.0 00000100:00100000:0.0:1788460602.893522:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460602.893587:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460602.893593:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482628096:0@lo:400:kworker.0 00000100:00100000:0.0:1788460602.893619:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460602.893656:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482628096 00000100:00100000:0.0:1788460602.893662:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482628096 00000100:00100000:0.0:1788460602.893708:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460602.893716:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482628096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460602.893766:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482628096:12345-0@lo:400:kworker.0 Request processed in 51us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460602.893774:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460602.893831:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482628096:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894075:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482627712:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894110:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460602.894137:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482628224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894157:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460602.894175:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788460602.894198:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482627840:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894220:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460602.894235:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482628352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894254:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460602.894278:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482628224 00000100:00100000:1.0:1788460602.894283:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482628224 00000100:00100000:1.0:1788460602.894308:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482628352 00000100:00100000:1.0:1788460602.894311:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482628352 00000100:00100000:1.0:1788460602.894325:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460602.894331:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482628224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894380:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482628224:12345-0@lo:400:kworker.0 Request processed in 48us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460602.894387:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460602.894400:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460602.894406:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482628352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894434:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482628352:12345-0@lo:400:kworker.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460602.894440:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460602.894465:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482628352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.894491:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482628224:0@lo:400:kworker.0 00000100:00100000:0.0:1788460602.894600:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627712 00000100:00100000:0.0:1788460602.894605:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627712 00000100:00100000:0.0:1788460602.894631:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788460602.894638:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482627712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460602.894682:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482627712:12345-0@lo:400:kworker.0 Request processed in 44us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460602.894689:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788460602.894715:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627968 00000100:00100000:0.0:1788460602.894719:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627968 00000100:00100000:0.0:1788460602.894746:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482627840 00000100:00100000:0.0:1788460602.894749:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482627840 00000100:00100000:0.0:1788460602.894767:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460602.894774:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482627968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460602.894823:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482627968:12345-0@lo:400:kworker.0 Request processed in 49us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460602.894829:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460602.894853:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460602.894861:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482627840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460602.894896:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482627840:12345-0@lo:400:kworker.0 Request processed in 37us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460602.894902:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788460602.894919:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460602.894923:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460602.894925:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460602.894955:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788460602.894967:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482627968:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.897824:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482627840:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.897952:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482627712:0@lo:400:kworker.0 00000100:00100000:1.0:1788460602.905745:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460602.905771:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482628480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460602.906118:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460602.907338:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482628480 00000100:00100000:3.0:1788460602.907349:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482628480 00000100:00100000:3.0:1788460602.907409:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460602.907417:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482628480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460602.907447:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460602.907512:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482628480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460602.907519:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460602.907589:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482628480:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788460603.000694:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc6eb25b-f5fb-4afa-a165-3499bc737f69 00010000:00010000:1.0:1788460603.406373:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460603.623637:0:16459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788460603.916464:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482628608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460603.916535:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460603.916669:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482628608 00000100:00100000:1.0:1788460603.916676:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482628608 00000100:00100000:1.0:1788460603.916720:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460603.916729:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482628608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460603.916760:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460603.916814:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482628608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460603.916820:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460603.917116:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482628608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460604.428448:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788460604.503935:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc6eb25b-f5fb-4afa-a165-3499bc737f69 00010000:00010000:3.0:1788460605.454334:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460605.675466:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460605.675505:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460605.675539:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460605.675569:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460605.675605:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460605.675625:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460605.675648:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460605.675675:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711808 00000100:00100000:0.0:1788460605.675684:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711808 00000100:00100000:0.0:1788460605.675733:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712064 00000100:00100000:0.0:1788460605.675737:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712064 00000100:00100000:0.0:1788460605.675750:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711680 00000100:00100000:0.0:1788460605.675753:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711680 00000100:00100000:0.0:1788460605.675765:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712192 00000100:00100000:0.0:1788460605.675767:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712192 00000100:00100000:0.0:1788460605.675783:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1788460605.675794:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2381:x1875336462711808:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460605.675862:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2381:x1875336462711808:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460605.675869:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1788460605.675885:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1788460605.675891:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2381:x1875336462712064:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460605.675917:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2381:x1875336462712064:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460605.675923:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1788460605.675934:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1788460605.675941:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2381:x1875336462711680:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460605.675962:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2381:x1875336462711680:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 22us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460605.675968:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:0.0:1788460605.675988:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460605.675995:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2381:x1875336462712192:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460605.676021:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2381:x1875336462712192:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460605.676027:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460605.676045:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711424 00000100:00100000:0.0:1788460605.676049:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711424 00000100:00100000:0.0:1788460605.676072:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:0.0:1788460605.676078:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2381:x1875336462711424:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460605.676102:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2381:x1875336462711424:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460605.676109:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:0.0:1788460605.676138:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711552 00000100:00100000:0.0:1788460605.676141:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711552 00000100:00100000:0.0:1788460605.676165:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462711936 00000100:00100000:0.0:1788460605.676167:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462711936 00000100:00100000:0.0:1788460605.676213:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:0.0:1788460605.676220:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:2381:x1875336462711552:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460605.676248:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:2381:x1875336462711552:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460605.676254:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:0.0:1788460605.676265:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1788460605.676271:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2381:x1875336462711936:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460605.676292:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2381:x1875336462711936:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 21us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460605.676307:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00080000:0.0:1788460605.676328:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460605.676332:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460605.676344:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788460606.476309:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788460606.881050:0:16609:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe78860000 20000000:00000080:1.0:1788460606.881069:0:16609:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff964fc18b5000 uarg=0000000000000000 20000000:01000000:1.0:1788460606.881107:0:16609:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788460606.881113:0:16609:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788460606.881117:0:16609:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788460606.882440:0:16610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788460606.884633:0:16609:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788460606.895112:0:16609:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788460606.895144:0:16609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895210:0:16609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b82e9 expref: 22 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895219:0:16609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8352 expref: 22 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895226:0:16609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b84b7 expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895236:0:16609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895243:0:16609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895250:0:16609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895291:0:16609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895307:0:16609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 13 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460606.895321:0:16609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec034e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482628736:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460606.895434:0:16609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 13 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895443:0:16609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 13 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460606.895459:0:16609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec035880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482628864:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460606.895492:0:16609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b84b7 expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.895500:0:16609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b84b7 expref: 22 pid: 14497 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460606.895510:0:16609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482628992:0@lo:104: 00000100:00100000:1.0:1788460606.895553:0:16609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460606.896576:0:14486:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788460606.896594:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482628992 00000100:00100000:3.0:1788460606.896602:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482628992 00000100:00100000:3.0:1788460606.896655:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460606.896664:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2de9e0bf-5e47-4625-abae-f266e65391be+3:16609:x1875336482628992:12345-0@lo:104: 00010000:00010000:3.0:1788460606.896680:0:14486:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.897025:0:16609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8352 expref: 22 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.897038:0:16609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8352 expref: 22 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460606.897051:0:16609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482629120:0@lo:104: 00010000:00010000:3.0:1788460606.905386:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788460606.905411:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec1b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2de9e0bf-5e47-4625-abae-f266e65391be+3:16609:x1875336482628992:12345-0@lo:104: Request processed in 8744us (9853us total) trans 0 rc 0/0 00010000:00010000:2.0:1788460606.905554:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460606.905563:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.905575:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460606.905579:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.905602:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460606.905610:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460606.905617:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788460606.905666:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.905674:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788460606.905678:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460606.905748:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482629248:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460606.905837:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.905844:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167c00/0x889bb893541b84b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b84be expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.905856:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460606.905858:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460606.905860:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460606.905927:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460606.906598:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460606.906883:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460606.906913:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712320 00000100:00100000:2.0:1788460606.906920:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712320 00010000:00010000:2.0:1788460606.906950:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 14 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460606.906968:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482629248 00000100:00100000:2.0:1788460606.906971:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482629248 00010000:00010000:2.0:1788460606.906983:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b84b7 expref: 23 pid: 14497 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460606.907007:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712448 00000100:00100000:2.0:1788460606.907010:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712448 00010000:00010000:2.0:1788460606.907023:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 15 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460606.907035:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1788460606.907043:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+15:2379:x1875336462712320:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460606.907055:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460606.907061:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 15 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.907086:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 15 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.907105:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460606.907148:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+15:2379:x1875336462712320:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 105us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460606.907154:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1788460606.907171:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460606.907192:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482629248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460606.907200:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460606.907215:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b84b7 expref: 23 pid: 14497 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.907222:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b84b7 expref: 23 pid: 14497 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.907242:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460606.907277:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482629248:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460606.907283:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460606.907296:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460606.907302:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2379:x1875336462712448:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460606.907310:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460606.907314:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 14 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.907323:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 14 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.907343:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460606.907361:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2379:x1875336462712448:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 59us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460606.907367:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1788460606.908086:0:16609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460606.908152:0:16609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b82e9 expref: 22 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460606.908164:0:16609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b82e9 expref: 22 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460606.908194:0:16609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482629376:0@lo:104: 00000100:00100000:0.0:1788460606.908234:0:16609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460606.908252:0:16609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571ce40 going to sleep for 11 seconds 00010000:00010000:0.0:1788460606.908275:0:16609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008800/0x889bb893541b8638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ed expref: 13 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460606.908286:0:16609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec034e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482628736:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460606.908298:0:16609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea5000/0x889bb893541b85f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1684 expref: 12 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460606.908307:0:16609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec035880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482628864:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460606.908316:0:16609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b84be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b84b7 expref: 22 pid: 14497 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460606.908347:0:16609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482628992:0@lo:104: 00000100:00100000:1.0:1788460606.909198:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482629120 00000100:00100000:1.0:1788460606.909215:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482629120 00000100:00100000:1.0:1788460606.909253:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482629376 00000100:00100000:1.0:1788460606.909255:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482629376 00000100:00100000:1.0:1788460606.909271:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460606.909279:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+4:16609:x1875336482629120:12345-0@lo:104: 00010000:00010000:1.0:1788460606.909294:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909368:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788460606.909374:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+4:16609:x1875336482629120:12345-0@lo:104: Request processed in 96us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460606.909402:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460606.909419:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460606.909425:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+3:16609:x1875336482629376:12345-0@lo:104: 00010000:00010000:1.0:1788460606.909433:0:14485:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909468:0:14485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788460606.909473:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2de9e0bf-5e47-4625-abae-f266e65391be+3:16609:x1875336482629376:12345-0@lo:104: Request processed in 49us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460606.909479:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788460606.909496:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460606.909502:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909509:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460606.909513:0:14491:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909520:0:14491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460606.909528:0:14491:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460606.909534:0:14491:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460606.909565:0:14491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909571:0:14491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460606.909592:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909599:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f5800/0x889bb893541b8352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8359 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909611:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460606.909613:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909619:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460606.909621:0:14491:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909627:0:14491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460606.909633:0:14491:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460606.909637:0:14491:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460606.909651:0:14491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909657:0:14491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460606.909671:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909677:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c29f4c00/0x889bb893541b82e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b82f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460606.909701:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460606.909703:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460606.909705:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460606.909717:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482629632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460606.909763:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460606.910316:0:16609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482629120:0@lo:104: 00000100:00100000:0.0:1788460606.910338:0:16609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16609:1875336482629376:0@lo:104: 00010000:00010000:0.0:1788460606.910365:0:16609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460606.910598:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482629632 00000100:00100000:2.0:1788460606.910604:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482629632 00010000:00010000:2.0:1788460606.910626:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b82e9 expref: 22 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460606.910660:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460606.910668:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+22:3318:x1875336482629632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460606.910678:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460606.910683:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b82e9 expref: 22 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.910706:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b82e9 expref: 22 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.910720:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d400/0x889bb893541b82f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b82e9 expref: 22 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.910733:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460606.910837:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+21:3318:x1875336482629632:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460606.910844:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460606.910876:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482629248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460606.910889:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460606.910897:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482629504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460606.910922:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460606.910955:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482629504 00000100:00100000:2.0:1788460606.910959:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482629504 00010000:00010000:2.0:1788460606.910972:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8352 expref: 21 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460606.910991:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460606.910997:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2de9e0bf-5e47-4625-abae-f266e65391be+21:3316:x1875336482629504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460606.911004:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460606.911008:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8352 expref: 21 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911017:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8352 expref: 21 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911038:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029c000/0x889bb893541b8359 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8352 expref: 21 pid: 14495 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911049:0:14487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911056:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911069:0:14487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911076:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911083:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911088:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911094:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460606.911097:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911105:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911116:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460606.911135:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460606.911163:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2de9e0bf-5e47-4625-abae-f266e65391be+20:3316:x1875336482629504:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460606.911169:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460606.911320:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482629632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460606.912544:0:16609:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460606.912556:0:16609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460606.912563:0:16609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c3fb5c00/0x889bb893541b8662 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460606.913411:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482629504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460606.913440:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460607.500436:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460607.975987:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460607.976050:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712576 00000100:00100000:0.0:1788460607.976059:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712576 00000100:00100000:0.0:1788460607.976135:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:0.0:1788460607.976144:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:13820:x1875336462712576:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460607.976160:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460607.976175:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea5e00/0x889bb893541b8669 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d171e expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460607.976230:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea5e00/0x889bb893541b8669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d171e expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460607.976241:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea5e00/0x889bb893541b8669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d171e expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460607.976259:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5e00, rc 0) 00000100:00100000:0.0:1788460607.976305:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13820:x1875336462712576:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 163us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460607.976312:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:3.0:1788460607.985296:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460607.985791:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712704 00000100:00100000:0.0:1788460607.985802:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712704 00000100:00100000:0.0:1788460607.985850:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1788460607.985859:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13820:x1875336462712704:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460607.986370:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13820:x1875336462712704:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 509us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460607.986379:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 122 00000100:00100000:0.0:1788460607.992651:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460607.992737:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712832 00000100:00100000:2.0:1788460607.992747:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712832 00000100:00100000:2.0:1788460607.992835:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:2.0:1788460607.992844:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13820:x1875336462712832:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460607.993298:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcd1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13820:x1875336462712832:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 453us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460607.993307:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:0.0:1788460608.004504:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460608.004971:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462712960 00000100:00100000:3.0:1788460608.004981:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462712960 00000100:00100000:3.0:1788460608.005046:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:3.0:1788460608.005057:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c533b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:13820:x1875336462712960:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460608.005073:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460608.005090:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029de00/0x889bb893541b8670 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1725 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.005115:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029de00/0x889bb893541b8670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1725 expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.005126:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029de00/0x889bb893541b8670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1725 expref: 14 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.005135:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029de00, rc 0) 00000100:00100000:3.0:1788460608.005469:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c533b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13820:x1875336462712960:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 412us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460608.005477:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 124 00000100:00100000:3.0:1788460608.008455:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460608.008622:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462713088 00000100:00100000:0.0:1788460608.008630:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462713088 00000100:00100000:0.0:1788460608.008673:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:0.0:1788460608.008683:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c533a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13820:x1875336462713088:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460608.008956:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c533a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13820:x1875336462713088:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 274us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460608.008965:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:1.0:1788460608.010945:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460608.012383:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482629760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460608.012442:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.012882:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482629760 00000100:00100000:3.0:1788460608.012890:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482629760 00000100:00100000:3.0:1788460608.012950:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788460608.012959:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482629760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460608.012992:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460608.013954:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482629760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 992us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460608.013965:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788460608.013992:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460608.014040:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482629760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460608.014482:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462713216 00000100:00100000:0.0:1788460608.014489:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462713216 00000100:00100000:0.0:1788460608.014529:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:0.0:1788460608.014538:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c533a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13820:x1875336462713216:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460608.014734:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c533a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:13820:x1875336462713216:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 196us (3794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460608.014742:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 126 00000100:00100000:3.0:1788460608.014989:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482630016:0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015028:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.015055:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788460608.015060:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482629888:0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015084:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.015108:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482630400:0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015132:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.015157:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630016 00000100:00100000:3.0:1788460608.015161:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630016 00000100:00100000:3.0:1788460608.015218:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460608.015226:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482630016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015263:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482630016:12345-0@lo:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460608.015269:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460608.015287:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630400 00000100:00100000:3.0:1788460608.015291:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630400 00000100:00100000:3.0:1788460608.015315:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788460608.015332:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482630400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015369:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482630400:12345-0@lo:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460608.015375:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788460608.015399:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482630144:0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015421:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.015449:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460608.015462:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630144 00000100:00100000:3.0:1788460608.015464:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482630272:0@lo:400:kworker.0 00000100:00100000:0.0:1788460608.015466:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630144 00000100:00100000:3.0:1788460608.015485:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460608.015488:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460608.015494:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482630144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015505:0:14501:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788460608.015512:0:14501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788460608.015526:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482630144:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460608.015532:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460608.015541:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630272 00000100:00100000:0.0:1788460608.015544:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630272 00000100:00100000:0.0:1788460608.015559:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460608.015563:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482630272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460608.015588:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482630272:12345-0@lo:400:kworker.0 Request processed in 24us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460608.015593:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788460608.015602:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460608.015606:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460608.015619:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482630272:0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015620:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482630400:0@lo:400:kworker.0 00000100:00100000:0.0:1788460608.015628:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482630144:0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015629:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482630016:0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015651:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482629888 00000100:00100000:3.0:1788460608.015654:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482629888 00000100:00100000:3.0:1788460608.015681:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788460608.015688:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+20:3317:x1875336482629888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460608.015721:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5338850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+20:3317:x1875336482629888:12345-0@lo:400:kworker.0 Request processed in 34us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460608.015727:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788460608.015752:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482629888:0@lo:400:kworker.0 10000000:01000000:3.0:1788460608.269387:0:14499:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788460608.269396:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c4ec5800 from 10 10000000:01000000:3.0:1788460608.269401:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460608.269442:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.269462:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.269473:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460608.269497:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.269559:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.269603:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460608.269624:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630528 00000100:00100000:3.0:1788460608.269630:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630528 00000100:00100000:3.0:1788460608.269675:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788460608.269683:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+20:14499:x1875336482630528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460608.269696:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460608.269708:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029cc00/0x889bb893541b867e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8677 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.269729:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029cc00/0x889bb893541b867e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8677 expref: 21 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.269739:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029cc00/0x889bb893541b867e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8677 expref: 21 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.269747:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029cc00, rc 0) 00000100:00100000:3.0:1788460608.269784:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482630528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460608.269791:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788460608.269845:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460608.269858:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.269867:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460608.270626:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000040:00080000:3.0:1788460608.273980:0:14499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460608.275414:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788460608.275489:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:3.0:1788460608.275539:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:3.0:1788460608.275576:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:3.0:1788460608.275612:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:3.0:1788460608.275663:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:3.0:1788460608.275699:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:3.0:1788460608.275734:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:3.0:1788460608.278600:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788460608.278616:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 9 count 10 00000100:00100000:3.0:1788460608.278712:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.278774:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.278822:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.278899:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630656 00000100:00100000:2.0:1788460608.278906:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630656 00000100:00100000:2.0:1788460608.278956:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788460608.278966:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482630656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.279576:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482630656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 610us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.279584:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788460608.279763:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.279802:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.279842:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.279875:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.279962:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630784 00000100:00100000:2.0:1788460608.279967:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630784 00000100:00100000:2.0:1788460608.280000:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788460608.280007:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482630784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.280157:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482630784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.280169:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788460608.280855:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460608.281531:0:14499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460608.281608:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630912:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.281662:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.281700:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.281799:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482630912 00000100:00100000:2.0:1788460608.281806:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482630912 00000100:00100000:2.0:1788460608.281839:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788460608.281847:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482630912:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.282007:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482630912:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 161us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.282015:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788460608.282480:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482630912:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460608.282704:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:3.0:1788460608.283877:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:3.0:1788460608.284107:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:3.0:1788460608.284149:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:3.0:1788460608.284978:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:3.0:1788460608.285052:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:3.0:1788460608.285095:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:3.0:1788460608.285131:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000100:00100000:3.0:1788460608.286035:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631040:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.286157:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.286441:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.293477:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631040 00000100:00100000:2.0:1788460608.293492:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631040 00000100:00100000:2.0:1788460608.296867:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788460608.296885:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482631040:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.297134:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482631040:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 254us (10983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.297142:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788460608.298373:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631040:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460608.298535:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:3.0:1788460608.298551:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:3.0:1788460608.301359:0:16666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64768 count 10 00000020:01000000:2.0:1788460608.301826:0:14499:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788460608.301842:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460608.301853:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460608.301864:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460608.301881:0:14499:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460608.301883:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff964fc19a9000 from 10 10000000:01000000:2.0:1788460608.301886:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460608.301922:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460608.301937:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460608.301947:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460608.301971:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.302035:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460608.302075:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.302094:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631168 00000100:00100000:2.0:1788460608.302099:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631168 00000100:00100000:2.0:1788460608.302136:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788460608.302145:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+21:14499:x1875336482631168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460608.302156:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460608.302168:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec009400/0x889bb893541b868c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8685 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460608.303312:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009400/0x889bb893541b868c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8685 expref: 22 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460608.303341:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec009400/0x889bb893541b868c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8685 expref: 22 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460608.303350:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009400, rc 0) 00000100:00100000:2.0:1788460608.303413:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1269us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.303421:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788460608.303701:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460608.303719:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.303728:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460608.305636:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 10 count 10 00000040:00080000:3.0:1788460608.312386:0:14499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460608.312713:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:3.0:1788460608.313984:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:3.0:1788460608.314065:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:3.0:1788460608.314105:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:3.0:1788460608.314142:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:3.0:1788460608.315338:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:3.0:1788460608.315416:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:3.0:1788460608.315453:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:3.0:1788460608.315539:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:3.0:1788460608.315548:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 9 count 10 00000100:00100000:3.0:1788460608.315658:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.315726:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.320480:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460608.321418:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631296 00000100:00100000:0.0:1788460608.321428:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631296 00000100:00100000:0.0:1788460608.321485:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788460608.321495:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460608.321786:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (6059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460608.321804:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788460608.325579:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460608.325642:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460608.325719:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460608.325774:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d0a98c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.325897:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631424 00000100:00100000:2.0:1788460608.325904:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631424 00000100:00100000:2.0:1788460608.325956:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788460608.325965:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.326145:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.326153:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788460608.326562:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788460608.327169:0:14499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460608.327884:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631552:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460608.327941:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460608.327982:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d0a98c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.328304:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631552 00000100:00100000:2.0:1788460608.328311:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631552 00000100:00100000:2.0:1788460608.328360:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788460608.328369:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631552:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.328545:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631552:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 176us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.328554:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788460608.328855:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631552:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460608.329093:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1788460608.329146:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1788460608.340963:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1788460608.341378:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1788460608.341421:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1788460608.341475:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1788460608.341512:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1788460608.341544:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:1.0:1788460608.341594:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f6054a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631680:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460608.341669:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460608.341710:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460608.341814:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631680 00000100:00100000:1.0:1788460608.341822:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631680 00000100:00100000:1.0:1788460608.341865:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788460608.341873:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631680:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460608.342058:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631680:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 185us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460608.342066:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788460608.342119:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f6054a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631680:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460608.342872:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:1.0:1788460608.342886:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:0.0:1788460608.356020:0:16670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 64768 count 10 00000020:01000000:3.0:1788460608.356306:0:14499:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788460608.356334:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460608.356345:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.356359:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460608.356371:0:14499:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788460608.356374:0:14499:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650c5014000 from 10 10000000:01000000:3.0:1788460608.356377:0:14499:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460608.356416:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.356424:0:14499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.356435:0:14499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460608.356467:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.356532:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.356572:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6ffe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460608.356592:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631808 00000100:00100000:3.0:1788460608.356599:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631808 00000100:00100000:3.0:1788460608.356648:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788460608.356657:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+22:14499:x1875336482631808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460608.356670:0:14495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460608.356681:0:14495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029d400/0x889bb893541b869a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8693 expref: -99 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.356704:0:14495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029d400/0x889bb893541b869a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8693 expref: 23 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.356715:0:14495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029d400/0x889bb893541b869a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8693 expref: 23 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.356722:0:14495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:3.0:1788460608.357881:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482631808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1219us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460608.357892:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788460608.357949:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460608.357967:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.357978:0:14499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460608.358030:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460608.358064:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460608.358088:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6ffe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460608.358104:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482631936 00000100:00100000:3.0:1788460608.358109:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482631936 00000100:00100000:3.0:1788460608.358144:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788460608.358152:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482631936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.360581:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482631936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2422us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.360595:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788460608.360640:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482631936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.360692:0:14499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482632064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.360736:0:14499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460608.361417:0:14499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460608.361436:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482632064 00000100:00100000:2.0:1788460608.361442:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482632064 00000100:00100000:2.0:1788460608.361480:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788460608.361490:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482632064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460608.361650:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:14499:x1875336482632064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460608.361662:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788460608.361707:0:14499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2de9e0bf-5e47-4625-abae-f266e65391be:14499:1875336482632064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460608.364109:0:16673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788460608.371901:0:14499:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788460608.371918:0:14499:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460608.371928:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460608.371940:0:14499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460608.533068:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460609.037381:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460609.037404:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482632192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460609.037588:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460609.039555:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482632192 00000100:00100000:3.0:1788460609.039568:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482632192 00000100:00100000:3.0:1788460609.039958:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788460609.039969:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482632192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460609.040005:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460609.040199:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482632192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460609.040206:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460609.040789:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482632192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460609.550044:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460610.535964:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460610.536144:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462713344 00000100:00100000:1.0:1788460610.536154:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462713344 00000100:00100000:1.0:1788460610.537220:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1788460610.537232:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:14476:x1875336462713344:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460610.537250:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460610.537265:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5000/0x889bb893541b86a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d172c expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.537327:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.537341:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.537353:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.537368:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.537375:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.537382:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788460610.537780:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788460610.539024:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4800/0x889bb893541b86b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539045:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4800/0x889bb893541b86b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539053:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4800/0x889bb893541b86b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460610.539079:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788460610.539082:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460610.539112:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4800/0x889bb893541b86b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539123:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539130:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539137:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539142:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460610.539146:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539153:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539166:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:1.0:1788460610.539169:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460610.539173:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539271:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4a00/0x889bb893541b86a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539283:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539287:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539291:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539294:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460610.539295:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539299:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539316:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9650e70d8600) 00010000:00010000:1.0:1788460610.539319:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460610.539322:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539328:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4c00/0x889bb893541b86af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539430:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5000/0x889bb893541b86a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d172c expref: 8 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539582:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4800/0x889bb893541b86b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d172c expref: 7 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460610.539590:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650e70d8700) 00010000:00010000:1.0:1788460610.539592:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460610.539594:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4800, rc 0) 00000100:00100000:1.0:1788460610.539869:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:14476:x1875336462713344:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2637us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460610.539878:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1788460610.552095:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460610.552425:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462713600 00000100:00100000:0.0:1788460610.553564:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462713600 00000100:00100000:0.0:1788460610.553641:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1788460610.553651:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:14476:x1875336462713600:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460610.553673:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460610.553830:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5800/0x889bb893541b86bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1733 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.553905:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.553919:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.553929:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.553997:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.554005:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.554013:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.554370:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5600/0x889bb893541b86d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.554380:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5600/0x889bb893541b86d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.554387:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5600/0x889bb893541b86d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460610.554402:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788460610.555106:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555117:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555124:0:14501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555130:0:14501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460610.555134:0:14501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555142:0:14501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555153:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650e70d8700) 00010000:00010000:0.0:1788460610.555156:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460610.555161:0:14501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555167:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b86c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555207:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555214:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555229:0:14501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555235:0:14501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460610.555238:0:14501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555245:0:14501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555253:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9650c7412b00) 00010000:00010000:0.0:1788460610.555256:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460610.555259:0:14501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.555264:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b86cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.556129:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5800/0x889bb893541b86bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1733 expref: 10 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.556149:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5600/0x889bb893541b86d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1733 expref: 9 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460610.556157:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650c7412d00) 00010000:00010000:0.0:1788460610.556160:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460610.556162:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5600, rc 0) 00000100:00100000:0.0:1788460610.556355:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14476:x1875336462713600:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 2704us (4267us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788460610.556373:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1788460610.566030:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.566149:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462713728 00000100:00100000:2.0:1788460610.566169:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462713728 00000100:00100000:2.0:1788460610.566257:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460610.566267:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14476:x1875336462713728:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788460610.566400:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14476:x1875336462713728:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 133us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460610.566408:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00010000:00010000:3.0:1788460610.572990:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460610.634435:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.634752:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462713856 00000100:00100000:3.0:1788460610.634762:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462713856 00000100:00100000:3.0:1788460610.634818:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460610.634827:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14482:x1875336462713856:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460610.634854:0:16645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460610.634887:0:16645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b86e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d173a expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.634943:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.634958:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.634970:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.634983:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.634989:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.634995:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635333:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635341:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635347:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635353:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460610.635357:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635373:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635385:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:3.0:1788460610.635388:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460610.635392:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635398:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b86e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635411:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635417:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635423:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635427:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460610.635430:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635435:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635440:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9650c52eda00) 00010000:00010000:3.0:1788460610.635442:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460610.635444:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635558:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b86ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635592:0:16645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b86e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d173a expref: 10 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635601:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:3.0:1788460610.635603:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460610.635607:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b86e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d173a expref: 10 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.635615:0:16645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4c00, rc 0) 00000100:00100000:3.0:1788460610.635771:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14482:x1875336462713856:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 943us (1344us total) trans 0 rc 301/301 00000100:00100000:3.0:1788460610.635779:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460610.647251:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460610.647680:0:14510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462713984 00000100:00100000:1.0:1788460610.647689:0:14510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462713984 00000100:00100000:1.0:1788460610.647795:0:14510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:1.0:1788460610.647807:0:14510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14482:x1875336462713984:12345-192.168.203.32@tcp:700:lfs.0 00000100:00100000:1.0:1788460610.647899:0:14510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14482:x1875336462713984:12345-192.168.203.32@tcp:700:lfs.0 Request processed in 94us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460610.647906:0:14510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1788460610.650121:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.650292:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462714240 00000100:00100000:2.0:1788460610.650310:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462714240 00000100:00100000:2.0:1788460610.650402:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:2.0:1788460610.650411:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14482:x1875336462714240:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:2.0:1788460610.650476:0:14502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460610.650503:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b861c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16ae expref: 9 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.650522:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:2.0:1788460610.650527:0:14502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460610.650740:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.650754:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 5 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.650769:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.650801:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 5 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.650814:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 5 pid: 14503 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460610.650828:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875336482632320:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460610.650993:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4567d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460610.653627:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875336482632320:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460610.653656:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460610.654811:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.655169:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462714368 00000100:00100000:2.0:1788460610.655210:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462714368 00010000:00010000:2.0:1788460610.655261:0:14489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 6 pid: 14503 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460610.655313:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1788460610.655322:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2380:x1875336462714368:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460610.655336:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460610.655343:0:14489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 6 pid: 14503 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655376:0:14489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 6 pid: 14503 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655398:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b865b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1717 expref: 6 pid: 14503 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655413:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:2.0:1788460610.655418:0:14489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655428:0:14489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655436:0:14489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655462:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460610.655507:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2380:x1875336462714368:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 186us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460610.655514:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00010000:00010000:2.0:1788460610.655539:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655546:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655567:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655587:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.655594:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460610.657721:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788460610.657738:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.657747:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.657754:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.657760:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460610.657764:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.657772:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.657786:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:2.0:1788460610.657789:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460610.657794:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.657800:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b86f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460610.657832:0:14502:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a248b6b reply state 00000000de4364dd transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788460610.657967:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460610.658009:0:14502:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460610.658150:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:14482:x1875336462714240:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 7736us (8034us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788460610.658158:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00010000:00010000:2.0:1788460610.661963:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.661982:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.661989:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.661996:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460610.662002:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.662009:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.662025:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9650c3cb0600) 00010000:00010000:2.0:1788460610.662029:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460610.662047:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.662054:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b86fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460610.747494:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.748734:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462714496 00000100:00100000:3.0:1788460610.748748:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462714496 00000100:00100000:3.0:1788460610.748953:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1788460610.748965:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:14490:x1875336462714496:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:3.0:1788460610.748991:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460610.749014:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b8703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1741 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.749082:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b870a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.749114:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b870a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.749125:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b870a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460610.749162:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460610.749166:0:14501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460610.750132:0:14501:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b870a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.750169:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4c00/0x889bb893541b8703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1741 expref: 11 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.750223:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b870a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1741 expref: 10 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.750232:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:2.0:1788460610.750235:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460610.750238:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4e00, rc 0) 00000100:00100000:2.0:1788460610.750324:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:14490:x1875336462714496:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 1361us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460610.750333:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:0.0:1788460610.785088:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.785367:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462714624 00000100:00100000:3.0:1788460610.785378:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462714624 00000100:00100000:3.0:1788460610.785444:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1788460610.785455:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:14491:x1875336462714624:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460610.785475:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460610.785495:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1748 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.785552:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b8718 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.785566:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b8718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.785579:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b8718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460610.785613:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460610.785617:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460610.785637:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b8718 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.785678:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1748 expref: 7 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.785697:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b8718 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1748 expref: 6 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.785705:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460610.785707:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460610.785711:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4a00, rc 0) 00000100:00100000:3.0:1788460610.786084:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:14491:x1875336462714624:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 630us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460610.786093:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1788460610.788014:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.788353:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462714752 00000100:00100000:3.0:1788460610.788364:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462714752 00000100:00100000:3.0:1788460610.788429:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:3.0:1788460610.788439:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:14491:x1875336462714752:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460610.788459:0:16645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460610.788479:0:16645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b871f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d174f expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788539:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788552:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788563:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788593:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788600:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788606:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788693:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8734 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788700:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788707:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460610.788746:0:16645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460610.788750:0:16645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460610.788767:0:16645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8734 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.788779:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789167:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789256:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789274:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460610.789278:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789285:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789296:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460610.789309:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460610.789315:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789321:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789337:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789343:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789348:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789354:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460610.789356:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789362:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789380:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9650c52edc00) 00010000:00010000:3.0:1788460610.789382:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460610.789385:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.789390:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b872d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.790147:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b871f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d174f expref: 8 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.790166:0:16645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8734 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d174f expref: 7 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.790174:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52ed600) 00010000:00010000:3.0:1788460610.790535:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460610.790539:0:16645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5a00, rc 0) 00000100:00100000:3.0:1788460610.790606:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+7:14491:x1875336462714752:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2167us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460610.790614:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:0.0:1788460610.792864:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460610.792907:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460610.792944:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460610.792979:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460610.793072:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460610.793103:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462715008 00000100:00100000:0.0:1788460610.793112:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462715008 00000100:00100000:0.0:1788460610.793159:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462715264 00000100:00100000:0.0:1788460610.793162:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462715264 00000100:00100000:0.0:1788460610.793208:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462715136 00000100:00100000:0.0:1788460610.793212:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462715136 00000100:00100000:0.0:1788460610.793225:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462715392 00000100:00100000:0.0:1788460610.793227:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462715392 00000100:00100000:0.0:1788460610.793242:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460610.793251:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2382:x1875336462715008:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460610.793330:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2382:x1875336462715008:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 79us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460610.793338:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460610.793356:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:0.0:1788460610.793363:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2382:x1875336462715264:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460610.793387:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2382:x1875336462715264:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460610.793421:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:0.0:1788460610.793433:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:0.0:1788460610.793439:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2382:x1875336462715136:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460610.793464:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2382:x1875336462715136:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460610.793470:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:0.0:1788460610.793480:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1788460610.793486:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2382:x1875336462715392:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460610.793507:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2382:x1875336462715392:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460610.793513:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00080000:0.0:1788460610.793531:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460610.793535:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460610.793987:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462714880 00000100:00100000:2.0:1788460610.793992:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462714880 00000100:00100000:2.0:1788460610.794040:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:2.0:1788460610.794050:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2382:x1875336462714880:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460610.794082:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2382:x1875336462714880:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 35us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460610.794088:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 141 00000100:00100000:0.0:1788460610.808113:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.808281:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462715648 00000100:00100000:2.0:1788460610.808291:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462715648 00000100:00100000:2.0:1788460610.808364:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1788460610.808375:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+7:14491:x1875336462715648:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460610.808423:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460610.808444:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b873b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1756 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460610.808534:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788460610.808666:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b873b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1756 expref: 9 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.808689:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:2.0:1788460610.808692:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460610.808698:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b873b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1756 expref: 9 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.808712:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008800, rc 0) 00000100:00100000:2.0:1788460610.808777:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+8:14491:x1875336462715648:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 404us (675us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788460610.808784:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1788460610.812992:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.813130:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462715904 00000100:00100000:2.0:1788460610.813141:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462715904 00000100:00100000:2.0:1788460610.813234:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1788460610.813245:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+8:14491:x1875336462715904:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:2.0:1788460610.813307:0:14501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460610.813337:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5a00/0x889bb893541b8734 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d174f expref: 8 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.813359:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52ed600) 00010000:00010000:2.0:1788460610.813371:0:14501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460610.813407:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.813422:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.813433:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460610.814552:0:14501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbad4ab0 reply state 000000001718003a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460610.814910:0:14501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788460610.814922:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788460610.815160:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+9:14491:x1875336462715904:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 1913us (2175us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788460610.815169:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00010000:00010000:3.0:1788460610.817609:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.817627:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.817635:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.817662:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460610.817666:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.817675:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.817704:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c3cb0600) 00010000:00010000:3.0:1788460610.817707:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788460610.817711:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.817718:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008400/0x889bb893541b8749 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460610.820015:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.820163:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462716160 00000100:00100000:3.0:1788460610.820173:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462716160 00000100:00100000:3.0:1788460610.820260:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1788460610.820269:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+8:14491:x1875336462716160:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1788460610.821977:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+9:14491:x1875336462716160:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1699us (1959us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788460610.821991:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1788460610.828022:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.828229:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462716416 00000100:00100000:2.0:1788460610.828241:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462716416 00000100:00100000:2.0:1788460610.828297:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:2.0:1788460610.828317:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+9:14491:x1875336462716416:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460610.828344:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460610.828365:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d175d expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828439:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828454:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828483:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828500:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828507:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828514:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460610.828617:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788460610.828731:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828739:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828745:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828751:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460610.828755:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828763:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828776:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:2.0:1788460610.828779:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460610.828799:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828806:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b8757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828819:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828826:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828831:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828836:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460610.828839:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828845:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828852:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9650c3cb0c00) 00010000:00010000:2.0:1788460610.828855:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460610.828857:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828862:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b875e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828897:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8750 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d175d expref: 11 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828918:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:2.0:1788460610.828921:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460610.828925:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d175d expref: 11 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.828935:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008800, rc 0) 00000100:00100000:2.0:1788460610.828989:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+10:14491:x1875336462716416:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 674us (977us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788460610.828996:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:0.0:1788460610.833156:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.833273:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462716544 00000100:00100000:3.0:1788460610.833284:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462716544 00000100:00100000:3.0:1788460610.833355:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1788460610.833365:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+10:14491:x1875336462716544:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460610.833388:0:16645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460610.833425:0:16645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b876c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1764 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.833514:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.833529:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.833555:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460610.833579:0:16645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460610.833582:0:16645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460610.833599:0:16645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.833624:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b876c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 12 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.833643:0:16645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 11 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.833651:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52edc00) 00010000:00010000:3.0:1788460610.833654:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460610.833658:0:16645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4000, rc 0) 00000100:00100000:3.0:1788460610.833731:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+11:14491:x1875336462716544:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 367us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460610.833739:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:1.0:1788460610.841635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.841718:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462716672 00000100:00100000:2.0:1788460610.841735:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462716672 00000100:00100000:2.0:1788460610.841804:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1788460610.841814:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+11:14491:x1875336462716672:12345-192.168.203.32@tcp:37:lfs.0 00000100:00100000:2.0:1788460610.847594:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+11:14491:x1875336462716672:12345-192.168.203.32@tcp:37:lfs.0 Request processed in 5768us (5958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460610.847608:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1788460610.851629:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.851715:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462716928 00000100:00100000:3.0:1788460610.851739:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462716928 00000100:00100000:3.0:1788460610.851845:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1788460610.851858:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c575e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+11:14491:x1875336462716928:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1788460610.852149:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c575e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+12:14491:x1875336462716928:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 293us (528us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788460610.852158:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460610.918960:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.919163:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462717056 00000100:00100000:3.0:1788460610.919206:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462717056 00000100:00100000:3.0:1788460610.919257:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1788460610.919267:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:14497:x1875336462717056:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460610.919293:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460610.919320:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b877a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d176b expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919385:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919399:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919409:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919423:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919430:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919437:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919520:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b878f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919528:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b878f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919535:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b878f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460610.919570:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460610.919573:0:14503:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460610.919604:0:14503:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b878f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919615:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919622:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919629:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919634:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460610.919638:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919645:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919656:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460610.919663:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460610.919668:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919675:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919689:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919695:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.919701:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.920421:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460610.920425:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.920432:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.920442:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9650c52edb00) 00010000:00010000:3.0:1788460610.920444:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460610.920447:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.920453:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b8788 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.920490:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b877a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d176b expref: 12 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.920516:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b878f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d176b expref: 11 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.920524:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52edc00) 00010000:00010000:3.0:1788460610.920526:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788460610.920528:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5400, rc 0) 00000100:00100000:3.0:1788460610.921875:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+11:14497:x1875336462717056:12345-192.168.203.32@tcp:101:bash.0 Request processed in 2277us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460610.921887:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1788460610.926842:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.926940:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462717312 00000100:00100000:2.0:1788460610.926950:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462717312 00000100:00100000:2.0:1788460610.927009:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:2.0:1788460610.927020:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+11:14497:x1875336462717312:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460610.927052:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460610.927071:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8796 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1772 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.927449:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.927477:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 11 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.927487:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.927522:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 11 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.927536:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 11 pid: 16645 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460610.927561:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875336482632448:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460610.927940:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c45676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460610.934058:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460610.934214:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462717440 00000100:00100000:3.0:1788460610.934224:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462717440 00010000:00010000:3.0:1788460610.934262:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 12 pid: 16645 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460610.934321:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1788460610.934331:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c615f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+12:2380:x1875336462717440:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460610.934353:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460610.934360:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 12 pid: 16645 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.934373:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 12 pid: 16645 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.934394:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52edc00) 00010000:00010000:3.0:1788460610.934398:0:14488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.934422:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.934431:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460610.934449:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460610.934503:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c615f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+12:2380:x1875336462717440:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 173us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460610.934510:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00010000:00010000:2.0:1788460610.935761:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b8773 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1764 expref: 11 pid: 16645 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460610.935783:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875336482632448:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460610.935805:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.935815:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.935820:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.935845:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.935865:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.935873:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937603:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937618:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937628:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460610.937638:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788460610.937663:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937670:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937677:0:14501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937682:0:14501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460610.937686:0:14501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937694:0:14501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937902:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52edc00) 00010000:00010000:2.0:1788460610.937905:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460610.937910:0:14501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937916:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b879d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460610.937930:0:14501:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001609d691 reply state 00000000de3e4bd3 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460610.937938:0:14501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788460610.937975:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8796 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 14 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937988:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 13 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.937995:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460610.937998:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788460610.938000:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009600, rc 0) 00000100:00100000:2.0:1788460610.938473:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+14:14497:x1875336462717312:12345-192.168.203.32@tcp:101:bash.0 Request processed in 11453us (11637us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788460610.938483:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00010000:00010000:2.0:1788460610.942287:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.942319:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.942342:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.942349:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460610.942355:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.942363:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.942380:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9650c3cb0c00) 00010000:00010000:2.0:1788460610.942383:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460610.942388:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.942395:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460610.975561:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.975674:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462717568 00000100:00100000:2.0:1788460610.975685:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462717568 00000100:00100000:2.0:1788460610.975744:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:2.0:1788460610.975756:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+13:14497:x1875336462717568:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460610.975780:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460610.975809:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1779 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.975881:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.975911:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.975923:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460610.975974:0:14502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788460610.975979:0:14502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460610.975997:0:14502:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.976007:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.976040:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009000/0x889bb893541b87b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 15 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.976061:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 14 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460610.976070:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460610.976073:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460610.976077:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008800, rc 0) 00000100:00100000:2.0:1788460610.976144:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+14:14497:x1875336462717568:12345-192.168.203.32@tcp:101:bash.0 Request processed in 391us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460610.976151:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:1.0:1788460610.979664:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460610.979748:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462717824 00000100:00100000:2.0:1788460610.979758:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462717824 00000100:00100000:2.0:1788460610.979820:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1788460610.979845:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+14:14497:x1875336462717824:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:2.0:1788460610.980438:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+15:14497:x1875336462717824:12345-192.168.203.32@tcp:35:bash.0 Request processed in 593us (782us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788460610.980447:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000040:00080000:0.0:1788460611.020853:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788460611.094235:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.094358:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462718080 00000100:00100000:3.0:1788460611.094369:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462718080 00000100:00100000:3.0:1788460611.094431:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:3.0:1788460611.094442:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+15:14507:x1875336462718080:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460611.094467:0:16645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460611.094487:0:16645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1780 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460611.094570:0:16645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788460611.094683:0:16645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1780 expref: 17 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.094698:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460611.094701:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460611.094718:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1780 expref: 17 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.094733:0:16645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5000, rc 0) 00000100:00100000:3.0:1788460611.094804:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+16:14507:x1875336462718080:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 364us (577us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788460611.094811:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:1.0:1788460611.098004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.098421:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462718336 00000100:00100000:3.0:1788460611.098433:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462718336 00000100:00100000:3.0:1788460611.098553:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1788460611.098565:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+16:14507:x1875336462718336:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:3.0:1788460611.098968:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec01c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+17:14507:x1875336462718336:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 404us (971us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788460611.098977:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460611.144096:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.144228:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462718592 00000100:00100000:3.0:1788460611.144239:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462718592 00000100:00100000:3.0:1788460611.144309:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1788460611.144321:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+17:14510:x1875336462718592:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460611.144348:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460611.144369:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1787 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.144469:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b87dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.144484:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b87dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.144496:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b87dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460611.144508:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788460611.144647:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1787 expref: 20 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.144667:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b87dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1787 expref: 19 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.144676:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460611.144679:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460611.144683:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5800, rc 0) 00000100:00100000:3.0:1788460611.144749:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+19:14510:x1875336462718592:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 430us (661us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788460611.144757:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1788460611.148650:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460611.148693:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.148773:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462718720 00000100:00100000:0.0:1788460611.148780:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462718848 00000100:00100000:3.0:1788460611.148784:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462718720 00000100:00100000:0.0:1788460611.148786:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462718848 00000100:00100000:3.0:1788460611.148848:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1788460611.148859:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:14510:x1875336462718720:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:3.0:1788460611.148931:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.148948:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.148960:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460611.148977:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1788460611.148987:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:2379:x1875336462718848:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460611.148988:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.149000:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.149000:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460611.149282:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.149383:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b87dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1787 expref: 20 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.149401:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460611.149412:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460611.149516:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+19:2379:x1875336462718848:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 529us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460611.149524:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00010000:00010000:3.0:1788460611.149688:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460611.149694:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.149703:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.149713:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460611.149715:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460611.149775:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.149782:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460611.149823:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+18:14510:x1875336462718720:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 966us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460611.149830:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:1.0:1788460611.154650:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460611.154760:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462719104 00000100:00100000:2.0:1788460611.154771:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462719104 00000100:00100000:2.0:1788460611.154826:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460611.154836:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+18:14510:x1875336462719104:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460611.155071:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+19:14510:x1875336462719104:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 236us (431us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788460611.155078:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1788460611.549081:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.549404:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462719360 00000100:00100000:3.0:1788460611.549414:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462719360 00000100:00100000:3.0:1788460611.549474:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:3.0:1788460611.549485:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+19:14541:x1875336462719360:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:3.0:1788460611.549508:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460611.549537:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d178e expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.549657:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.549672:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.549683:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460611.549694:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788460611.549853:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b87f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d178e expref: 22 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.549875:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d178e expref: 21 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.549884:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460611.549887:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460611.549891:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5000, rc 0) 00000100:00100000:3.0:1788460611.549950:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+21:14541:x1875336462719360:12345-192.168.203.32@tcp:101:cat.0 Request processed in 468us (881us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788460611.549958:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:1.0:1788460611.559994:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460611.560039:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460611.560217:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462719744 00000100:00100000:0.0:1788460611.560227:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462719744 00000100:00100000:0.0:1788460611.560312:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:0.0:1788460611.560322:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+21:2380:x1875336462719744:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460611.560337:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460611.560360:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b87f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d178e expref: 21 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.560379:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460611.560384:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460611.560442:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:2380:x1875336462719744:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 122us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460611.560449:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:2.0:1788460611.561366:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462719616 00000100:00100000:2.0:1788460611.561376:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462719616 00000100:00100000:2.0:1788460611.561426:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460611.561437:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:14541:x1875336462719616:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:2.0:1788460611.561793:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+21:14541:x1875336462719616:12345-192.168.203.32@tcp:35:cat.0 Request processed in 357us (1807us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788460611.561801:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:1.0:1788460611.597392:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460611.620720:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460611.621123:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462720000 00000100:00100000:2.0:1788460611.621136:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462720000 00000100:00100000:2.0:1788460611.621418:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:2.0:1788460611.621430:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+21:14547:x1875336462720000:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:2.0:1788460611.621454:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460611.621485:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8806 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1795 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.621608:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.621623:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 22 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.621632:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 22 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.621640:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.621676:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 22 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.621690:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 22 pid: 14502 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460611.621703:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875336482632576:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460611.621859:0:14501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 22 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.621869:0:14501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 22 pid: 14501 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460611.621878:0:14501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875336482632704:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460611.621910:0:14501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4567a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460611.628475:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460611.628780:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462720128 00000100:00100000:0.0:1788460611.628790:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462720128 00010000:00010000:0.0:1788460611.628839:0:14487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 23 pid: 14502 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460611.628881:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460611.628890:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+23:2379:x1875336462720128:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460611.628904:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460611.628910:0:14487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 23 pid: 14502 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.628941:0:14487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 23 pid: 14502 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.628963:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460611.628968:0:14487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.628976:0:14487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.628983:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460611.629036:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+23:2379:x1875336462720128:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 146us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460611.629044:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00010000:00010000:2.0:1788460611.629851:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b87c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1779 expref: 22 pid: 14502 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460611.629870:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875336482632576:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460611.629883:0:14501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff965101d8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14501:1875336482632704:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460611.629907:0:14501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460611.637395:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.637486:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462720256 00000100:00100000:3.0:1788460611.637497:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462720256 00010000:00010000:3.0:1788460611.637613:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 22 pid: 14501 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460611.637700:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460611.637724:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+22:2380:x1875336462720256:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460611.637739:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460611.637746:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 22 pid: 14501 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.637760:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 22 pid: 14501 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.637782:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009600/0x889bb893541b87ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1772 expref: 22 pid: 14501 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.637797:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460611.637802:0:14488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.638043:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.638055:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.638091:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460611.638159:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+21:2380:x1875336462720256:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 436us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460611.638167:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:2.0:1788460611.638722:0:14501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.638733:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460611.638754:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788460611.638930:0:14501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8806 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1795 expref: 22 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.638945:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1795 expref: 21 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.638953:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460611.638955:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460611.638958:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008600, rc 0) 00000100:00100000:2.0:1788460611.639006:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+21:14547:x1875336462720000:12345-192.168.203.32@tcp:101:dd.0 Request processed in 17580us (18324us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788460611.639013:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:1.0:1788460611.644962:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.645046:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462720512 00000100:00100000:3.0:1788460611.645055:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462720512 00000100:00100000:3.0:1788460611.645102:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1788460611.645111:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+21:14547:x1875336462720512:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:3.0:1788460611.645468:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.645488:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.645500:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460611.645552:0:14503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788460611.645589:0:14503:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bae88b42 reply state 000000009b057367 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460611.645597:0:14503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460611.645745:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14547:x1875336462720512:12345-192.168.203.32@tcp:36:dd.0 Request processed in 633us (792us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788460611.645752:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000020:00080000:3.0:1788460611.645757:0:14503:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788460611.652056:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:3.0:1788460611.652679:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.652693:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.652700:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.652706:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460611.652711:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.652719:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.652871:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460611.652876:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460611.652882:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.652889:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b881b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460611.652994:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462720640 00000100:00100000:0.0:1788460611.653004:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462720640 00000100:00100000:0.0:1788460611.653058:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:0.0:1788460611.653067:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+23:14547:x1875336462720640:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:0.0:1788460611.653092:0:16645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460611.653109:0:16645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8822 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d179c expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.659684:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8822 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d179c expref: 24 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.659710:0:16645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8822 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d179c expref: 24 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.659763:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460611.659767:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460611.659771:0:16645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea4a00, rc 0) 00000100:00100000:0.0:1788460611.660154:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14547:x1875336462720640:12345-192.168.203.32@tcp:101:dd.0 Request processed in 7085us (8106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460611.660164:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1788460611.682789:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460611.682974:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462720896 00000100:00100000:0.0:1788460611.682984:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462720896 00000100:00100000:0.0:1788460611.683047:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:0.0:1788460611.683057:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14547:x1875336462720896:12345-192.168.203.32@tcp:103:dd.0 00010000:00010000:0.0:1788460611.683071:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460611.683093:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8822 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d179c expref: 24 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460611.683113:0:14489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460611.683118:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460611.683207:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+23:14547:x1875336462720896:12345-192.168.203.32@tcp:103:dd.0 Request processed in 118us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460611.683215:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1788460611.692786:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460611.692880:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462721024 00000100:00100000:3.0:1788460611.692889:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462721024 00000100:00100000:3.0:1788460611.692946:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1788460611.692957:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+23:14547:x1875336462721024:12345-192.168.203.32@tcp:58:dd.0 00010000:00010000:3.0:1788460611.693052:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.693070:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460611.693082:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460611.693850:0:14503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460611.694009:0:14503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788460611.694077:0:14503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788460611.694209:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+23:14547:x1875336462721024:12345-192.168.203.32@tcp:58:dd.0 Request processed in 1250us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460611.694219:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:1.0:1788460611.696606:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460611.696701:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462721152 00000100:00100000:2.0:1788460611.696712:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462721152 00000100:00100000:2.0:1788460611.696769:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1788460611.696779:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+23:14547:x1875336462721152:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:2.0:1788460611.696799:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460611.696819:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17a3 expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.696872:0:14501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.696884:0:14501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 24 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.696904:0:14501:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.696917:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 24 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.696930:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:2.0:1788460611.696933:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460611.696937:0:14501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 24 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460611.696945:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec009800, rc 0) 00000100:00100000:2.0:1788460611.697001:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14547:x1875336462721152:12345-192.168.203.32@tcp:101:dd.0 Request processed in 223us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460611.697022:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000040:00080000:0.0:1788460612.046031:0:14535:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788460612.046040:0:14535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460612.046076:0:14535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788460612.046083:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788460612.046226:0:14535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14535:1875336482632832:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460612.046356:0:14535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460612.053591:0:14535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec035c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14535:1875336482632832:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788460612.057265:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.065928:0:14512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462721280 00000100:00100000:2.0:1788460612.065943:0:14512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462721280 00000100:00100000:2.0:1788460612.066027:0:14512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1788460612.066039:0:14512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14549:x1875336462721280:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788460612.066136:0:14512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14549:x1875336462721280:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 Request processed in 101us (8880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460612.066145:0:14512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00080000:0.0:1788460612.066692:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460612.073441:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.073524:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462721408 00000100:00100000:3.0:1788460612.073533:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462721408 00000100:00100000:3.0:1788460612.073605:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1788460612.073615:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14549:x1875336462721408:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460612.073648:0:14503:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460612.073778:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14549:x1875336462721408:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 163us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460612.073786:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1788460612.086361:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460612.086746:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462721536 00000100:00100000:0.0:1788460612.086757:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462721536 00000100:00100000:0.0:1788460612.086884:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:0.0:1788460612.086895:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14549:x1875336462721536:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788460612.086965:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.086982:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.086997:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087067:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087075:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087093:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087115:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087124:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087131:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460612.087225:0:16645:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788460612.087229:0:16645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460612.087241:0:16645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087252:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087259:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087268:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087275:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.087279:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087300:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087312:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650c7412d00) 00010000:00010000:0.0:1788460612.087315:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460612.087319:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087325:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4a00/0x889bb893541b8837 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087339:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087357:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087363:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087368:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.087371:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087377:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087385:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9650c7412b00) 00010000:00010000:0.0:1788460612.087387:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460612.087389:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087396:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b883e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087408:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087413:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087423:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087428:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.087435:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087441:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087449:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460612.087451:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460612.087454:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.087459:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b8845 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.087875:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14549:x1875336462721536:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 978us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460612.087886:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:1.0:1788460612.093774:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.093859:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462721792 00000100:00100000:3.0:1788460612.093869:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462721792 00000100:00100000:3.0:1788460612.093928:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:3.0:1788460612.093940:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+24:14549:x1875336462721792:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460612.093960:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460612.093979:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b884c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17aa expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094085:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094099:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094110:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460612.094121:0:14503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788460612.094256:0:14503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094265:0:14503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094284:0:14503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094301:0:14503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460612.094306:0:14503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094313:0:14503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094326:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:3.0:1788460612.094329:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788460612.094334:0:14503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094340:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b8853 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094384:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b884c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17aa expref: 26 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094394:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650c7412d00) 00010000:00010000:3.0:1788460612.094397:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460612.094401:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b884c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17aa expref: 26 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.094410:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4400, rc 0) 00000100:00100000:3.0:1788460612.094468:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+25:14549:x1875336462721792:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 531us (703us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788460612.094484:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:3.0:1788460612.097338:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.097484:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462721920 00000100:00100000:2.0:1788460612.097494:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462721920 00000100:00100000:2.0:1788460612.097557:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:2.0:1788460612.097569:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+25:14549:x1875336462721920:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460612.097637:0:14501:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788460612.097937:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+25:14549:x1875336462721920:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 369us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460612.097945:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:1.0:1788460612.105375:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.105546:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462722176 00000100:00100000:2.0:1788460612.105558:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462722176 00000100:00100000:2.0:1788460612.105615:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1788460612.105625:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+25:14549:x1875336462722176:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460612.105646:0:14502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460612.105666:0:14502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8861 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17b1 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460612.109593:0:14502:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788460612.109622:0:14502:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788460612.109728:0:14502:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788460612.111100:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8868 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.111121:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.111132:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8868 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.111219:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8861 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17b1 expref: 28 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.111239:0:14502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8868 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17b1 expref: 27 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.111248:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c3cb0c00) 00010000:00010000:2.0:1788460612.111252:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460612.111255:0:14502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008800, rc 0) 00000100:00100000:2.0:1788460612.111648:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+27:14549:x1875336462722176:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 6022us (6280us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788460612.111658:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1788460612.116923:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.117075:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462722432 00000100:00100000:1.0:1788460612.117085:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462722432 00000100:00100000:1.0:1788460612.117143:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1788460612.117154:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+27:14549:x1875336462722432:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460612.117234:0:16645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460612.117259:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008800/0x889bb893541b8868 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17b1 expref: 27 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117287:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c3cb0c00) 00010000:00010000:1.0:1788460612.117307:0:16645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460612.117328:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117342:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117361:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117386:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117394:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117400:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117459:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117482:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117489:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117495:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460612.117499:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117507:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117516:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52edc00) 00010000:00010000:1.0:1788460612.117519:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460612.117523:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117529:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5200/0x889bb893541b8876 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117539:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117545:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117551:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117556:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460612.117565:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117572:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117581:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb2b73f7c (ffff9650e70d8600) 00010000:00010000:1.0:1788460612.117584:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460612.117587:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.117593:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b887d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb2b73f7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.117680:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+26:14549:x1875336462722432:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 527us (764us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460612.117688:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1788460612.122857:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.123335:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462722560 00000100:00100000:3.0:1788460612.123346:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462722560 00000100:00100000:3.0:1788460612.123464:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1788460612.123476:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+26:14549:x1875336462722560:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460612.123498:0:14503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460612.123523:0:14503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8884 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17b8 expref: -99 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.123561:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b888b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.123576:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b888b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.123587:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b888b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.123714:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b8884 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17b8 expref: 28 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.123735:0:14503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b888b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17b8 expref: 27 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.123743:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:3.0:1788460612.123746:0:14503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460612.123758:0:14503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f5000, rc 0) 00000100:00100000:3.0:1788460612.123824:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+27:14549:x1875336462722560:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 350us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460612.123831:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:3.0:1788460612.127546:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.127908:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462722816 00000100:00100000:1.0:1788460612.127920:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462722816 00000100:00100000:1.0:1788460612.128026:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1788460612.128037:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+27:14549:x1875336462722816:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460612.128120:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.128139:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.128152:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460612.128638:0:16645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788460612.128650:0:16645:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 485364470273ns, next at 486364467720ns, rc = 0 00000004:00010000:1.0:1788460612.128759:0:16645:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e7cbdc7 reply state 00000000b29a009c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.128769:0:16645:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460612.128876:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+29:14549:x1875336462722816:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 839us (1338us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788460612.128883:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00010000:00010000:0.0:1788460612.130635:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.130649:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.130655:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.130661:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.130666:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.130672:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.130686:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:0.0:1788460612.130689:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788460612.130706:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.130713:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4000/0x889bb893541b8892 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460612.132745:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.137848:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462722944 00000100:00100000:2.0:1788460612.137866:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462722944 00000100:00100000:2.0:1788460612.137957:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:2.0:1788460612.137968:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+28:14549:x1875336462722944:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460612.137992:0:14501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460612.138013:0:14501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17bf expref: -99 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.138087:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 29 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.138102:0:14501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 29 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.138120:0:14501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:2.0:1788460612.138123:0:14501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460612.138126:0:14501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008e00, rc 0) 00000100:00100000:2.0:1788460612.138216:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+29:14549:x1875336462722944:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 250us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460612.138224:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:3.0:1788460612.140752:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.140872:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462723072 00000100:00100000:1.0:1788460612.140882:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462723072 00000100:00080000:0.0:1788460612.141003:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460612.141085:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1788460612.141097:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2379:x1875336462723072:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788460612.141680:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:2379:x1875336462723072:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 583us (933us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788460612.141688:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1788460612.155526:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.158134:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462723328 00000100:00100000:3.0:1788460612.158150:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462723328 00000100:00100000:0.0:1788460612.160608:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:0.0:1788460612.160622:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+29:14549:x1875336462723328:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788460612.160866:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+30:14549:x1875336462723328:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 245us (5348us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788460612.160875:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1788460612.169913:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.170240:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462723584 00000100:00100000:1.0:1788460612.170250:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462723584 00000100:00100000:1.0:1788460612.170437:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1788460612.170448:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+30:14549:x1875336462723584:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788460612.170603:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+30:14549:x1875336462723584:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 155us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460612.170611:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:1.0:1788460612.173385:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.173509:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462723712 00000100:00100000:3.0:1788460612.173519:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462723712 00000100:00100000:3.0:1788460612.173576:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1788460612.173586:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+30:14549:x1875336462723712:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460612.173605:0:16645:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460612.173624:0:16645:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b88a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17c6 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.173696:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b88a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.173710:0:16645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b88a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.173731:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b88a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460612.173764:0:16645:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460612.173780:0:16645:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b88a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16645 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.173805:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5800/0x889bb893541b88a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17c6 expref: 32 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.173836:0:16645:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b88a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17c6 expref: 31 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.173844:0:16645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:3.0:1788460612.173847:0:16645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788460612.173850:0:16645:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c29f4400, rc 0) 00000100:00100000:3.0:1788460612.173910:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+31:14549:x1875336462723712:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 325us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460612.173917:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1788460612.178875:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.182509:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462723840 00000100:00100000:3.0:1788460612.182525:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462723840 00000100:00100000:2.0:1788460612.182668:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1788460612.182679:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+6:2380:x1875336462723840:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460612.182699:0:15184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460612.182732:0:15184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17cd expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460612.182760:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99be43, blocks: 0x1 00010000:00010000:2.0:1788460612.182779:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788460612.182783:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460612.182792:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 7 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.182830:0:15184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 7 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.182842:0:15184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008400, rc 0) 00000100:00100000:2.0:1788460612.182910:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2380:x1875336462723840:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 233us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460612.182917:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1788460612.186851:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.186933:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462724096 00000100:00100000:3.0:1788460612.186942:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462724096 00000100:00100000:3.0:1788460612.186994:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:3.0:1788460612.187003:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+31:14549:x1875336462724096:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788460612.187101:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff965101d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+31:14549:x1875336462724096:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460612.187108:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:3.0:1788460612.191044:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.191222:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462724224 00000100:00100000:1.0:1788460612.191247:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462724224 00000100:00100000:1.0:1788460612.191319:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1788460612.191330:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+31:14549:x1875336462724224:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788460612.304015:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788460612.304036:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788460612.304057:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1788460612.304077:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788460612.304228:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+14:14549:x1875336462724224:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 112894us (113190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460612.304238:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:1.0:1788460612.304952:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650ec037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482632960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788460612.305007:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460612.307324:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482632960 00000100:00100000:3.0:1788460612.307337:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482632960 00000100:00100000:3.0:1788460612.307463:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788460612.307472:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482632960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788460612.307646:0:15187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788460612.307650:0:15187:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788460612.307667:0:15187:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788460612.307669:0:15187:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788460611 -> 1788460611 00002000:00010000:3.0:1788460612.307672:0:15187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788460612.307743:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482632960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 272us (2735us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788460612.307750:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788460612.307801:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650ec037480/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788460612.307806:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650ec037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482632960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788460612.308063:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.308125:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462724352 00000100:00100000:2.0:1788460612.308130:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462724352 00000100:00100000:2.0:1788460612.308167:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1788460612.308174:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2380:x1875336462724352:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788460612.308276:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2380:x1875336462724352:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460612.308283:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00080000:1.0:1788460612.309205:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460612.311353:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.311520:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462724608 00000100:00100000:3.0:1788460612.311529:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462724608 00000100:00100000:3.0:1788460612.311583:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1788460612.311592:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+14:14549:x1875336462724608:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460612.311642:0:14503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460612.311669:0:14503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4400/0x889bb893541b88a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17c6 expref: 14 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.311689:0:14503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:3.0:1788460612.311693:0:14503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460612.311721:0:14503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.311732:0:14503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.311741:0:14503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460612.311927:0:14503:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017dcc49a reply state 000000002f9f654e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460612.311953:0:14503:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460612.312051:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+15:14549:x1875336462724608:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 459us (706us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788460612.312057:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1788460612.316257:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00010000:00010000:3.0:1788460612.316404:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.316417:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.316426:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.316433:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460612.316438:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.316445:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.316463:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:3.0:1788460612.316466:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460612.316471:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.316478:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4000/0x889bb893541b88b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.316714:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462724736 00000100:00100000:1.0:1788460612.316724:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462724736 00000100:00100000:1.0:1788460612.316779:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1788460612.316789:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2380:x1875336462724736:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788460612.316986:0:15187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788460612.316989:0:15187:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788460610 00002000:00010000:1.0:1788460612.316992:0:15187:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788460610 00002000:00010000:1.0:1788460612.316993:0:15187:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788460611 -> 1788460610 00002000:00010000:1.0:1788460612.316995:0:15187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788460612.317059:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+8:2380:x1875336462724736:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 271us (811us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788460612.317067:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1788460612.323213:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.323310:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462724864 00000100:00100000:2.0:1788460612.323332:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462724864 00000100:00100000:2.0:1788460612.323599:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460612.323611:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650ec034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+8:2380:x1875336462724864:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788460612.323656:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323672:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460612.323676:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460612.323682:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323696:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323727:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323736:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323744:0:15184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323752:0:15184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460612.323756:0:15184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323777:0:15184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323793:0:15184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.323801:0:15184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a40acb0d/0x889bb893541b88bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460612.323893:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650ec034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+8:2380:x1875336462724864:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 283us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460612.323900:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1788460612.325629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460612.325920:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462725120 00000100:00100000:0.0:1788460612.325931:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462725120 00000100:00100000:0.0:1788460612.326017:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:0.0:1788460612.326027:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+14:14549:x1875336462725120:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788460612.326108:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.326127:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.326138:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.326972:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.326990:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 15 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.326999:0:14502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.327033:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 15 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.327047:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 15 pid: 14501 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460612.327060:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875336482633088:192.168.203.32@tcp:104: 00000100:00100000:0.0:1788460612.327153:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460612.332205:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.332265:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462725248 00000100:00100000:1.0:1788460612.332275:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462725248 00010000:00010000:1.0:1788460612.332327:0:14488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 16 pid: 14501 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.333388:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:1.0:1788460612.333406:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+16:2380:x1875336462725248:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460612.333423:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460612.333444:0:14488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 16 pid: 14501 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.333460:0:14488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 16 pid: 14501 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.333482:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:1.0:1788460612.333488:0:14488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.333499:0:14488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.333506:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.333526:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460612.333589:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+16:2380:x1875336462725248:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 189us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460612.333596:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:0.0:1788460612.333804:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008e00/0x889bb893541b8899 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17bf expref: 15 pid: 14501 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460612.333821:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875336482633088:192.168.203.32@tcp:104: 00010000:00010000:0.0:1788460612.333843:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.333851:0:14502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.333856:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460612.334024:0:14502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788460612.334159:0:14502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788460612.334241:0:14502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788460612.334345:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14502:1875336482633216:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788460612.334570:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460612.334601:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460612.334641:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482633216 00000100:00100000:0.0:1788460612.334647:0:14506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482633216 00000100:00100000:0.0:1788460612.334684:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460612.334691:0:14506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14502:x1875336482633216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788460612.334752:0:14506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14502:x1875336482633216:12345-0@lo:1000:mdt00_001.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460612.334758:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460612.334799:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14502:1875336482633216:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788460612.336880:0:14502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788460612.339730:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14502:1875336482633344:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788460612.339801:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460612.339848:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c571ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460612.340129:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482633344 00000100:00100000:3.0:1788460612.340136:0:14506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482633344 00000100:00100000:3.0:1788460612.340260:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788460612.340272:0:14506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14502:x1875336482633344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788460612.341151:0:14506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14502:x1875336482633344:12345-0@lo:1000:mdt00_001.0 Request processed in 876us (1344us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788460612.341160:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460612.342667:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14502:1875336482633344:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788460612.342717:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342729:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342737:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342765:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.342770:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342778:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342793:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:0.0:1788460612.342796:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460612.342800:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342806:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88ca lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342841:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342847:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342852:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342857:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.342860:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342865:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342883:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460612.342885:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460612.342893:0:14502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 18 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342905:0:14502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 18 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342913:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 18 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.342948:0:14502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 18 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460612.342961:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875336482633472:192.168.203.32@tcp:105: 00000100:00100000:0.0:1788460612.343046:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460612.351407:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460612.351613:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14502:1875336482633472:192.168.203.32@tcp:105: 00010000:00010000:0.0:1788460612.351644:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351653:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5600/0x889bb893541b8829 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351687:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351700:0:14502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351725:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351735:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351741:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351748:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351753:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.351757:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351764:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351774:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460612.351777:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460612.351780:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351785:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4000/0x889bb893541b88d1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351794:0:14502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351799:0:14502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351811:0:14502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351816:0:14502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460612.351819:0:14502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351825:0:14502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351833:0:14502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460612.351836:0:14502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460612.351839:0:14502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.351845:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.352048:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462725376 00000100:00100000:1.0:1788460612.352056:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462725376 00000100:00100000:0.0:1788460612.352074:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+19:14549:x1875336462725120:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 26046us (26450us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788460612.352086:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000020:00080000:0.0:1788460612.352092:0:14502:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788460612.352109:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460612.352120:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f584f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+18:14547:x1875336462725376:12345-192.168.203.32@tcp:49:dd.0 00000040:00080000:3.0:1788460612.352520:0:14535:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788460612.352526:0:14535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460612.352569:0:14535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000100:00100000:1.0:1788460612.352912:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f584f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+18:14547:x1875336462725376:12345-192.168.203.32@tcp:49:dd.0 Request processed in 792us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460612.352922:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000040:00080000:3.0:1788460612.355258:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788460612.360246:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460612.360624:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462725632 00000100:00100000:0.0:1788460612.360635:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462725632 00000100:00100000:0.0:1788460612.360704:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460612.360722:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+18:14549:x1875336462725632:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788460612.361463:0:14505:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788460612.361569:0:14505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788460612.361617:0:14505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.361634:0:14505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.361645:0:14505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.361653:0:14505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.361659:0:14505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.361664:0:14505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.361690:0:14505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460612.361775:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:14549:x1875336462725632:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1059us (1534us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788460612.361783:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000020:00080000:0.0:1788460612.361788:0:14505:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788460612.362252:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460612.362260:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.362270:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460612.362274:0:14490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.362282:0:14490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.362304:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:3.0:1788460612.362307:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788460612.362312:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.362318:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5a00/0x889bb893541b88d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14505 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.362342:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460612.362344:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460612.362347:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460612.594701:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460612.594842:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460612.594981:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.595025:0:15190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462725760 00000100:00100000:3.0:1788460612.595035:0:15190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462725760 00000100:00100000:3.0:1788460612.595113:0:15190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462725888 00000100:00100000:3.0:1788460612.595116:0:15190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462725888 00000100:00100000:3.0:1788460612.595136:0:15190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1788460612.595146:0:15190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:2382:x1875336462725760:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1788460612.595205:0:15190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.595224:0:15190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 9 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.595233:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460612.595237:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460612.595241:0:15190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.595277:0:15190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 9 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.595303:0:15190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 9 pid: 15184 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460612.595335:0:15190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15190:1875336482633600:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460612.595424:0:15190:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d297cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460612.595977:0:15192:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788460612.595987:0:15192:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788460612.596313:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726016 00000100:00100000:3.0:1788460612.596318:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726016 00000100:00100000:2.0:1788460612.596776:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1788460612.596787:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:2382:x1875336462725888:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:2.0:1788460612.596812:0:16723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.596826:0:16723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460612.596830:0:16723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460612.596834:0:16723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.596842:0:16723:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460612.599213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460612.599220:0:15190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15190:1875336482633600:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460612.599248:0:15190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.599427:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726144 00000100:00100000:1.0:1788460612.599435:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726144 00010000:00010000:1.0:1788460612.599479:0:14489:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 11 pid: 15184 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.599515:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1788460612.599524:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c615dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+11:2379:x1875336462726144:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460612.599536:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460612.599556:0:14489:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 11 pid: 15184 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.599568:0:14489:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 11 pid: 15184 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.599597:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e150f846/0x889bb893541b88ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17cd expref: 11 pid: 15184 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.599613:0:14489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.599617:0:14489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.599622:0:14489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.599632:0:14489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.599641:0:14489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.599643:0:14489:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.599647:0:14489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.599665:0:14489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.599699:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460612.599746:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c615dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:2379:x1875336462726144:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 223us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460612.599755:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00010000:00010000:3.0:1788460612.599789:0:15190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.599798:0:15190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.600625:0:16723:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.600635:0:16723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.621762:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788460612.696495:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1788460612.696534:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1788460612.697136:0:15190:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788460612.697140:0:15190:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788460610 -> 1788460611 00002000:00010000:3.0:1788460612.697144:0:15190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788460612.697156:0:15190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697206:0:15190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697225:0:15190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697249:0:15190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460612.697253:0:15190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697262:0:15190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697281:0:15190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697300:0:15190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea206f23/0x889bb893541b88df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460612.697386:0:15190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:2382:x1875336462725760:12345-192.168.203.32@tcp:4:dd.0 Request processed in 102236us (102690us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788460612.697396:0:15190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1788460612.697426:0:15190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1788460612.697437:0:15190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:2381:x1875336462726016:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1788460612.697474:0:15190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697488:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460612.697492:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460612.697499:0:15190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.697524:0:15190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460612.770850:0:16723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788460612.770858:0:16723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1788460612.770873:0:16723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.770885:0:16723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.770893:0:16723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.770899:0:16723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460612.770905:0:16723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.770914:0:16723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.770935:0:16723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.770943:0:16723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3b91b2a/0x889bb893541b88e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460612.771069:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+11:2382:x1875336462725888:12345-192.168.203.32@tcp:4:dd.0 Request processed in 174280us (176222us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788460612.771084:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000001:00080000:0.0:1788460612.771120:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788460612.803634:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788460612.803795:0:15190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788460612.803812:0:15190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.803825:0:15190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.803835:0:15190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.803842:0:15190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460612.803848:0:15190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.803856:0:15190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.803874:0:15190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.803882:0:15190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b88ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460612.803998:0:15190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2381:x1875336462726016:12345-192.168.203.32@tcp:4:dd.0 Request processed in 106560us (209013us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788460612.804007:0:15190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:3.0:1788460612.819109:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.819353:0:15192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726272 00000100:00100000:2.0:1788460612.819373:0:15192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726272 00000100:00100000:2.0:1788460612.819448:0:15192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1788460612.819460:0:15192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462726272:12345-192.168.203.32@tcp:4:dd.0 00002000:00010000:2.0:1788460612.819507:0:15192:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a99be43, atime: 0x6a99be42, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1788460612.819516:0:15192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.819532:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788460612.819536:0:15192:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460612.819543:0:15192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460612.819558:0:15192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460612.821315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.821372:0:16723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726400 00000100:00100000:1.0:1788460612.821381:0:16723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726400 00000100:00100000:1.0:1788460612.821438:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460612.821448:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2379:x1875336462726400:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:1.0:1788460612.821476:0:16723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.821491:0:16723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.821495:0:16723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.821501:0:16723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.821514:0:16723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460612.828487:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.828641:0:15191:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788460612.828651:0:15191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788460612.830734:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726528 00000100:00100000:2.0:1788460612.830747:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726528 00000100:00100000:3.0:1788460612.831378:0:15190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1788460612.831392:0:15190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+9:2379:x1875336462726528:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:3.0:1788460612.831430:0:15190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.831434:0:16726:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788460612.831447:0:16726:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00010000:00010000:3.0:1788460612.831451:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460612.831459:0:15190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460612.831465:0:15190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460612.831481:0:15190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460612.838532:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460612.838655:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460612.838777:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726784 00000100:00100000:1.0:1788460612.838788:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726784 00000100:00100000:1.0:1788460612.838856:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726656 00000100:00100000:1.0:1788460612.838860:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726656 00000100:00100000:1.0:1788460612.838880:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460612.838890:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:2380:x1875336462726784:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:1.0:1788460612.838930:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.838949:0:15191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.838953:0:15191:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.838960:0:15191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.838975:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460612.938649:0:16723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:1.0:1788460612.938659:0:16723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788460611 00002000:00010000:1.0:1788460612.938663:0:16723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:1.0:1788460612.938678:0:16723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.938693:0:16723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.938702:0:16723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.938729:0:16723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460612.938734:0:16723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.938745:0:16723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.938767:0:16723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.938776:0:16723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d28258d2/0x889bb893541b88fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460612.938889:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:2379:x1875336462726400:12345-192.168.203.32@tcp:4:dd.0 Request processed in 117438us (117577us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788460612.938901:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460612.938934:0:16723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1788460612.938946:0:16723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+19:2380:x1875336462726656:12345-192.168.203.32@tcp:4:dd.0 00010000:00010000:1.0:1788460612.938976:0:16723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.938989:0:16723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.938994:0:16723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460612.939000:0:16723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460612.939027:0:16723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.947083:0:15192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.947105:0:15192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.947113:0:15192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.947121:0:15192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460612.947126:0:15192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.947135:0:15192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.947432:0:15192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460612.947442:0:15192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026651593/0x889bb893541b88f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460612.947547:0:15192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+19:2380:x1875336462726272:12345-192.168.203.32@tcp:4:dd.0 Request processed in 128086us (128443us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788460612.947557:0:15192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000001:00080000:0.0:1788460612.947598:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:3.0:1788460613.039104:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1788460613.039942:0:15190:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:3.0:1788460613.040001:0:15190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460613.040032:0:15190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460613.040085:0:15190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460613.040093:0:15190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c29f4400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460613.040102:0:15190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460613.040119:0:15190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460613.040151:0:15190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.040224:0:15191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.040234:0:15191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.040241:0:15191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.040247:0:15191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460613.040251:0:15191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.040259:0:15191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.040271:0:15191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.040277:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f84195/0x889bb893541b8909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460613.040338:0:15190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ae4456/0x889bb893541b8902 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460613.040370:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:2380:x1875336462726784:12345-192.168.203.32@tcp:4:dd.0 Request processed in 201477us (201844us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788460613.040371:0:15190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+10:2379:x1875336462726528:12345-192.168.203.32@tcp:4:dd.0 Request processed in 208984us (211906us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788460613.040380:0:15190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460613.044777:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00002000:00010000:1.0:1788460613.090315:0:16723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788460613.090339:0:16723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.090364:0:16723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.090373:0:16723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.090381:0:16723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460613.090386:0:16723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.090395:0:16723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.090417:0:16723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460613.090440:0:16723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d5873b8/0x889bb893541b8910 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460613.090538:0:16723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+7:2380:x1875336462726656:12345-192.168.203.32@tcp:4:dd.0 Request processed in 151591us (251877us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788460613.090566:0:16723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000001:00080000:1.0:1788460613.090603:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000100:00100000:3.0:1788460613.132510:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460613.132534:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482633728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460613.132622:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460613.132703:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482633728 00000100:00100000:3.0:1788460613.132710:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482633728 00000100:00100000:3.0:1788460613.132754:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460613.132763:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482633728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460613.132802:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1788460613.132849:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482633728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460613.132856:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460613.132908:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788460613.132914:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9650ec037480, transno 8589934595 00000004:00080000:3.0:1788460613.132925:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788460613.132949:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482633728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460613.138625:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482634112:0@lo:400:kworker.0 00000100:00100000:2.0:1788460613.138691:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460613.138775:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482633856:0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.138809:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460613.138844:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460613.138850:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482633984:0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.138886:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460613.138919:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482633856 00000100:00100000:0.0:1788460613.138927:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482633856 00000100:00100000:0.0:1788460613.138969:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788460613.138976:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482633856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.139021:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482633856:12345-0@lo:400:kworker.0 Request processed in 45us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460613.139028:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788460613.139070:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482633856:0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.143010:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482634240:0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.143083:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460613.143269:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482634112 00000100:00100000:3.0:1788460613.143278:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482634112 00000100:00100000:3.0:1788460613.143338:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482634240 00000100:00100000:3.0:1788460613.143342:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482634240 00000100:00100000:3.0:1788460613.143372:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788460613.143381:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482634112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.143472:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460613.143482:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482634240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.143522:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482634240:12345-0@lo:400:kworker.0 Request processed in 42us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460613.143546:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460613.143594:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482634240:0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.144078:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482633984 00000100:00100000:0.0:1788460613.144084:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482633984 00000100:00100000:0.0:1788460613.144125:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788460613.144133:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460613.144202:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482633984:12345-0@lo:400:kworker.0 Request processed in 69us (5313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460613.144208:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788460613.144241:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482633984:0@lo:400:kworker.0 00000100:00100000:1.0:1788460613.144399:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460613.144412:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482634368:0@lo:400:kworker.0 00000100:00100000:1.0:1788460613.144459:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788460613.144493:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460613.144498:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460613.144507:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482634368 00000100:00100000:1.0:1788460613.144511:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482634368 00000100:00100000:1.0:1788460613.144542:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460613.144549:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482634368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460613.144584:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482634368:12345-0@lo:400:kworker.0 Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460613.144590:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788460613.144604:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460613.144742:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482634368:0@lo:400:kworker.0 00000100:00100000:3.0:1788460613.148406:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482634112:12345-0@lo:400:kworker.0 Request processed in 5015us (9702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460613.148423:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788460613.149301:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482634112:0@lo:400:kworker.0 00010000:00010000:3.0:1788460613.648038:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460614.156414:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460614.156439:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482634496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460614.156511:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460614.156622:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482634496 00000100:00100000:1.0:1788460614.156629:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482634496 00000100:00100000:1.0:1788460614.156680:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460614.156699:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482634496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460614.156735:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460614.156782:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482634496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460614.156790:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460614.156835:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482634496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788460614.668924:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788460614.768350:0:16765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788460615.693540:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460615.918024:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460615.921216:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460615.921254:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460615.921296:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460615.921326:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460615.921348:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460615.921372:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460615.921407:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462727168 00000100:00100000:3.0:1788460615.921428:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462727168 00000100:00100000:3.0:1788460615.921479:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462727680 00000100:00100000:3.0:1788460615.921482:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462727680 00000100:00100000:3.0:1788460615.921498:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462727296 00000100:00100000:3.0:1788460615.921499:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462727296 00000100:00100000:3.0:1788460615.921509:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462727552 00000100:00100000:3.0:1788460615.921511:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462727552 00000100:00100000:3.0:1788460615.921525:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460615.921534:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2379:x1875336462727168:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460615.921603:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2379:x1875336462727168:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460615.921609:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460615.921625:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1788460615.921631:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2379:x1875336462727680:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460615.921655:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2379:x1875336462727680:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460615.921661:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1788460615.922026:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1788460615.922035:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2379:x1875336462727296:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460615.922062:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2379:x1875336462727296:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460615.922069:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1788460615.922082:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1788460615.922089:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2379:x1875336462727552:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460615.922111:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2379:x1875336462727552:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 24us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460615.922125:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:3.0:1788460615.922152:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462727424 00000100:00100000:3.0:1788460615.922157:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462727424 00000100:00100000:3.0:1788460615.922212:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462727040 00000100:00100000:3.0:1788460615.922215:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462727040 00000100:00100000:3.0:1788460615.922238:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1788460615.922245:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2379:x1875336462727424:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460615.922290:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2379:x1875336462727424:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 46us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460615.922297:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1788460615.922773:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:3.0:1788460615.922783:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:2379:x1875336462727040:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460615.922818:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f6057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+20:2379:x1875336462727040:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 38us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460615.922824:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00080000:3.0:1788460615.922855:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460615.922859:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460615.922862:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460615.930537:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462726912 00000100:00100000:0.0:1788460615.930549:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462726912 00000100:00100000:0.0:1788460615.930611:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 143 00000100:00100000:0.0:1788460615.930623:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2379:x1875336462726912:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460615.930724:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2379:x1875336462726912:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 104us (13052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460615.930732:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 143 Debug log: 30915 lines, 30915 kept, 0 dropped, 0 bad.